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. |i/ V - PREFACE / ' ' 

pam of thie pregging Issuaa for educational R 6i D Is.to build *and 
Injteg^tei the fieW of educational R 6c D systema atudies^ To meet ' 
this need' will requira* ^ / . 

1. an under standing of the nature% atructuM and funqCionlt^ = 
^ - i^f RV^lt D systems as they intaract with their environments ; 

« . ■ ■ * . ^ ► • " 

2. an understand tng of educatiot\al R&D and of the edueatlonal 
contekt In which It exists and with which it interacts; * 

\ 3* jin light of the above j 'an understanding of the applicability 
I (or^i non-applicability) for aducational R & b of the R^ D 
j models, technoloEy And axparianee t?o be" found In other sactors 

■ r . ■' ^ ^ ^ ' ■ ■ ' - 

4, j ai la ijnplied In the above, an understanding oj the basis for 
' comparative analysis R & D systems across sectors. ' 

It is to the above tasks which this report addresses itself , fringing 
to bear an inCerdiscipllnary R&D perspectivas of fcnenibers of the 
research teM at the Center fpr the Intardlscipllnai^. Study of Science 
and Technology at Northwestern University (CISST)^ * ^ 

This is an abridged varsion of a very much longer report (ovfer 1>200 
pages) which Is being ^revised Into three separate volumes. These later 
volumes will eKpand the dtscuasion in this report by providing a com- 
prehensive Qontextual analysis of the education sector and by including 
contextual and issue analyses not included in this report* Further j 
the, later volumes will be written for. specific audiences. One volume 
will be for R & D systems researchers ^ 'elaborating the contextual ana- 
lytical framework and methodology and exploring its utility^ for iden- 
tifying research issues and generating research agendas* A second , 
volume will be for policy analysts and policy makers describing the . 



mdthodoJLogy in .m< Mnnar »^ to meet poliGy heeds attd^ Illustrating * 

4 the utlilCy of the contextual analytical frMieworfe by praseitta^lon V 
of pojley analyses we have .conducte^d for NIE and other agencies* 
A third vo^lume will be Eir^Qted tb .the educational R/D&I^ conmunltyi 
provMing a Gomprehenslve analysis of the key. aspects of the educational 
R/D^eX system-^ An addendum to^this vQlume will provide an extensive 
anhotatad bibliography oft the educational R/pM literat'ura. ^ ^ 

This presmnt report ^111 include :the following i ' 

* *" . , . ' - »^ -' , 

^Cl^pters One and Two (Sectioti Ona) will prdvi4e ^ basic understanding 
of the process &f contextuitl, analysis for U/Dfitl* ^^^fc ^ 

Chapter One will discuss the nature and bases for a contextual 
. - • analytical approach and then will describe' and discuss the 

CIS ST comparative contextual analytical frmaewrk. : ^' 

* Chapter Two will then expand the discussion of the major aspects 
(which we will call "features-^) pf-=an R/D&I context* / 

Chaptfers Thtee through Five (Section Two) wilt then provide lllus- ' . 
tratlve detailed taalysls of the contexts of sele'cted sectors j using . 
the CisST a^lytical framework. 

Chapter Three will fofcus on the education i,ector3 and will sum- 
marise the discussion to be ^^esentad in" mor^ compirehensive 
detail In the later, volume on educatlcpal R/D&Iw 

y. " ^ ^ ^ . . J ., * . 

Chapter^ Four will focus on the civilian aviation sactor, - * 



^Research, Development and Innovation (R/d&I) * As will be diBCUSsed 
in Chapter One , we use this , tefm to dascrlbe the total prpcess" of ^ 
innovation. 



J chapter Fiva will provlda a sunmarlzad illuatrati^ of a 
. er@sa^sectoral compara^ve cdhtaKtual analysis.* Tha^ sectors 
included are education and civilian aviatlon\(as discussed in^ 
this report) ; and haalth^ law anforcemant and industry (for ^ 
i^idh mora detailed conteKtual-, ana]|ysis will ba provided . in 
pit© tff-the later volumes), ' ^ , 



Chapters Six dnd Seven (Section Thrae) will illustrate how tha " 
oont ex tual analytical approach may be used to anklyza' spaclf ic 
R/D&I is sues. , 

^ ; V . ^- . . ■ 

Ghaptar> Slsl will foctfs the institutional base of R/D6eI 
systamSs with particular attention being given to how the , 
R/DW functions^ are "clustered" together within and ampng^ 
the institutions q£> R/D&I systems.' , ' 

* Chapter Seven will focus on the issue of antrepenaurship as 
this, relates to the historicaL and current state of developT 
. ■ ment' of R/D&I systems * ^ ■ "^'^ - . 

Chapter Eight and the Appendisf (Section Four) pro^ida ^ in affect, 
a "look , back" and a "look ahead", . - ' ^ I 

^Chapter Eight (the Coficlu'feiion chapter) will briafl^y review 
this report -and suggest ways the contextual analytical • ap- 
proaph inay be util|.zed. ' 

The -Append ix will provide an-^^eiccer^t from one policy issue^ 
analysis and brief descriptions of other^ issue areas where 
we . have thus far utilized (or proposed to utilize) the con^ 
textual analytical approach discussed in this report* 



*The speed fl'c meaning we attach to the term "R/D&I functions" will 
be discussed in Chapter One. 



* * 



tabu: of coktents 



Tablt of CDntants 



Sectl^rOnai 'The Fr^ework fbr/a Cdntaxtual Analytical Approa 
to R^D&l 



Chaptar Onai ^ The Cdmparattve Cofttextual AMlsais of 
/ 'Research 5 Davaiopmfnt and Innovation Sgs^ 

tama I ' an Overvlaw , * ^ 



/ 



|(haptar Twor ^ Illustratij^a Discussion of tha* R/D€e1 
/ '' \- * Contaxtual Features \ - 

SacrtSn^WQ- IllustraJtive Contaxtual Analysis of Sf lectad r7D6iI 
- ; '* * Sectors . ^ . , 

■ Chapter* Three r The R/DW ConteKt in the Education ^Seator 



1 



^1 

127 



Chapter Fovr* .*Tha R/D&I. Context in the Civilian Aviation 
Sector * * ^ 



SfCtion Thrae: Illustrattve Contexjtual Ankrygis of Selected 



Feature Igsuej 

Chap,ter Six- Institutional Base: The Netwbrk of R/D&I 
> ^ ' IndtitQtions 



243 



Chapter Five: An rllustrative Cros s -Sectoral , Comparative . 

. ^ Contextual Ariafysia . / * 297 



325 



327 



EKLC 



ACK^OWLEDgmENTS 

We wish to acknowledge th^ Invaluable ^assistan^e provided In the pre-^ 
paration qf this report by our administrative assistants Mrs* JEllaabeth 

N* Olmsted, whose help enabled us to prepare this report at this ttoe* ^ 

^ -. . ■■ ^ ■ ' . ^ . ■ ■ 

We also wish to acknowledge th^ Invaluable assistance of Alden S, Bean^ 
Ronald toTOiuy^ Hendrik Gldaonesai Burkh^rdt HoL^ner and Ward Mason who 
were willing to read the original draft of this teports participate in 
a workshop discuaaion of the ortginal drafts and offer very helpful 
critiques , ^ , 



1 - ■ ■ 



1 i 



\ ■ , , .... , 

. SECTION onT ' , ; ' 

■- * ■ \ V • ■ 

THE FR^WORK FOR A CONTtXTUAL AMLWZ^L 
APPRQACH TO R/DM . 



> Chaptar Onei The eomparativb Contaxtual Analysis of Research ^ 

* ■ ■ I ' - _ " - " i ' ^ 

Development and Innovation systams! an pvervlaw 

Ghaptar Two: Illustrative Discussion of the^R/D4£l Contextual^ 
Featuras ^ 



1 



10 




Ca&PTER ONE ,^ 



THE COMPAEATIVE AmtYSIS OF RESEARCffls^ DEVEJLOPmNT 
AND imOVATim 8YSTEMS! AN O^RVIEW 



11 



J 



o 

ERIC 



■■■■ - ■ . : - . .. . ' ^ . . . y^-' ^ ■ . -^ ■ : .. * . ■ ^ ' . A -. ■ 

■ / . THE COMPABATIVE ANALYSIS OF RESI^RCH, D&^LOBffiNr . ^ ^ ^ ■ ^ V - 

- I . AND INNOVATION SYSTEMS i "an OVERVIEW ^ ^ . ' ^ y 



I, ^ " ^ INTRODUCTION . ' : * ' ^ . ^ 

II, S^ffl^NITIAL CONSIDERATIONS ' * - 

— ' . ! Research, Devalopment and InriDVatipn R/DM as a 

\ ' " Total Procass of Inriovation v ^ ^ ^ \ * 

^: 2* The Process for ^ava loping a Comp^ratlva Anal^^ieal Framework 

3, The Emergent Nature of Real-World^^R;/D&I Systems - 

4, Sdma Kay Tarminology . . . , _ ^ ^ ; . 

5, A Theotettcal Framework as an Access to Analysis ; ' 

A, Tha Listing of Paatures ' \, - ■ * * 

B. R/D&l System Configurations ^ ' \ 
, ^. C, The ConfLguration of Functions i An Emargent dependent 

' - Issue ' "" ■ ' ^ ■ ' . ^ , ■ ^ ■ ^ . > 

III. R/D6.I SYSTEMS I SECTORAL. DIFFEREHGES AND GENERIC COMMONALITIES . 

. Defining a: ''Sector" 

' . , 2fc j'^The Naceasity pf a Saptoral Basis of Gomparlsoii ' \ 

* 3, EKistlng R/DH System Variations ' ' 

^ A, Illustrations of R/D^cl System VariatlDas Across SectQrs 

,.B*^ Some Additional R/D^I System Sectoral variances ^ 
4- Commonalities ^ong Exlatlng R/p&I Systems ^ 

5, Sector Vs* Generic: The N^ed for a Framework for Comparativa 
\ - '-^ ^ Analysis of R/D&I Systems. ^ ' ^ 

6. Three Central Questions of this Analysis * . ^ 

.'. ^i' \ , ' ' 

IV. \ 'A FRAMEWORK FOR CQMPARATIVE ANALYSIS^'OF R/D&i SYSTEMS ^ ' / 

1* Jhe Perspective of General Systems Theory 

A. /System .Definition ^ ' . " 

B. Innovation and Operating Systems' - , , 
1 C. Extent of R/D6el System Litikage . , , 

D* Matur'ation (State of ' Development)^ . , 

2* A Framework for "Mii "Level'- Analysis - ^ 

'3. Describing R/D&X Systems in Terms of Their Interactive . 
^ Features 

4* The' ConteKt of an R/D&I ^ System / - 

5* A Framework. Jor a Oomparative Sectoral Analysis o^ / 
_/ R/D&I Systems - ^ ^ / 

( ^ Am k Focused Process of Analysis. , ^ ■ ■ , ' * 

^ B. A Cumulative Process of Analyeis 

C s Interact i'^e Analysis by Cot\text 

D, Delineation of Generic and Sectoral Char acteristics 
E* /An Iterative^ Process = ■ - 

F.* Surmnary ' . ..^ ? t 

- • ■ •■ n ■ 



ERIC 



- 6 , 



4^ 

V. CONCLUSION 



6,.. Agency, use of'j the Compar;ative Analytical Framework 
7. ^De due jive or Induce tive Analysis . ^ . 



FIGURES 1 ^ ^ . . ^ ' ^ ; ' 

Figujre 1 -'i Comparative R/D&I S^fcem Features ^. ^ * ^' ? 

Figure 2 An Example of the Process for Narrowing the /Focus of Analysii 
Figure 3 Framework for Comparative Sectoral Analysis of R/D&I Syatems 



Figure 4 Analytical Frainiwork for Policy Makers: . 
' rjv ^ Ident if Icatiqri Ind Evaluation of Policies ^nd Strategies' 

Figure 5 A Deduct iXre /inductive Framework 




ERIC 



4 



• ■ . •.-/.' 



CHAPTER^ ONE , 



THE cbMFARATIVE CONTEXTUAL AH|i-LYSIS OF RESEARCH.^ PfeVELO^NT 



km INNOVATION SYSTEMS^ AN OOTRVIE^ 



INTRODUCTION 



Ona of the central issiies in educatidji is* the need to develbp our knowledge 
and ^skills In educational R&D policy making and management* To respond 
adequately tp ,this heed requires at least the following: s 

1/ ar^ adequate description of educational R&D as it currently exists; 
2. identification of 'those aspects of R&D which are generic ; i.e., 
which are in some way common acrAs different ^^fctors or fields ^ 
■'I (e*g*5 healths education^ aerospace, etc,) if ind'^ed such 

- generic characte'riatlcs do exist; 
\3* identification of those aspec^Cs of educational R&D which are sectoraPi-^ 
= ^1*46*5 specific to the nature of education .and educational R&D (and 
^hy) ; ^ ' . ^ 

4. determining j in light of the above, why educational R&D systems ^ 
have the character they do and function or operate in the ways in 
which we observe them to do . 

When^ the above analyses^ are made and interacted with each other, we can 

begin to ';ga|n Insight into policies and strategies which are specifically 

, relevant to educational R&D^ while at the same time allowing relevant 

transfer of ^ R&D^Sanagement tec^hnology and expedience from non- educational 

sectors* , ' ^ • = 

i. ' f 

This project focuses primarily on the second of the above points (though 
one of our sectoral analyses will be of education) . That is to say, the 
task 'of this project is to develop the' outline of a framework for comparative 
analysis which will enable us to understand observed differencea and/or 
commonalities in R&D systems across the various sectors. It is further the 
task of this project- to demonstrate the utility of such an analytical frame= 

14 
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work in terras both of policy making and -management and of transfer of 
releyant technologies and experience across sectors * 

, Policymaking and, management in R&D musC sail the narrow straits between 
^ Gharybdds and Scylla, with the danger of non-relevant ^ge^heralizations on 
the one side fnd the danger of rei^^ition of ,well-est-ablished principles 
on=,the other sjde. - At prf Sent there does' not exist the analytical framd= J, 

, work for R6^^ which could 'map this narrow channel £&r policy making /manage- 
ment navigators. 'It' is our hop^to provide at least the 'basic outline of 
such a map . * . • 

II. SO^ INITIAL CONS iPERAT IONS ' ^ ' ^ ^ . 

Before beginning to develop a framework for comparative analysis of R/D&I 
. syrtems, it is Impottant to pro^^de some initial background concepts and 
understandings from which we will be working. ^ r ' ^ 

1. Research, De veloipment' and Innovation R/tf&i as a total .process- of 

Innovation ' . ^' ^ 

From this point on, we ^11 be using the term "Research,. Development and ^ 
Innovation (R/D&I)'^ instead of the more comnon term "Research ind^^Developi 
ment (R6iD).*» Our reason l^s simple. The term "R&D»' tends to imply -a very 
narrow part of the total spectrum of function^ .and activities involved in 
a total process of innovatipn. . Research and development are essentially 
"pra-user" aspects bf the total Innovation process. A t^tal Ini^vation process 
a^^ Includes such "pbst-^development"^ functions such as production, dis- 
samlnatlon (a key linking function) and acqulsltlon/implementatlon/utiliEatlon 
(user functions). A total innovation process axso recognizee that users may/ 
also be innovators, ^ 

Thus, a complete conceptualiEation of an R/D&I system (i.e., a totar in- 
novation process) requires that we recofnizeit as spanning the total know- 
iMg^^^uction (KP) to knowledge ullAization (KU) spectrum. Thus, thia 
total spectrum of R/S&I activities witl include not only research (both 
basic and applifed) and development, but also production, dissemination^ 
acquisition, implementation, utilization, evaluation research, etc. Further, i 



- '9 



we must also have an undarstand tng q^^^ opatative conditions that exiat* 
within and affect tha R/D&I syrtem (e.g.: the state of system maturity; 
the peraonnel haae; funding lavels and patterns; etc*). Finally j we 
must also take Into account the enviroriment with.'whlch the R/D&r system 
interacts. , . ' ^ ^ ? . 

Such a coit^leta conceptua^llzation of a total Innovation ' (r/d&I) process ' 
recognizes tha many variations of innovation processes ^= for example: 
the role of' "creative inrlght'* by an in^vidual apart from any rasearch or 
development (e.g.: by an educational practitioner); or that a specific 
function (e.g.: ^research) may in practice exist in a rather isolat'ed 
fashion* Howeverj conceptualization of a total R/D&I process willlenable 



us to evaluate tha overall role and effects of such various types o^ in= 
novation activities. ' ' ^ . V-^^^^ 



1' 



Thus J we will use the term ''R/D&I'*, 
2. The Process for Developing a Comparative Analytical Fr^m^wo^rk 

Tha process we have used in ^developing the comparative analytical frama^ 
work to be presented here has been an iterative process. Thuj^ the relevant ' 
literature and the extensive experience of CISST personnel and /Northwestern 
University was used to make a "first cut", tentative identification ot key 
variables (which we will later label as "features") which would seem to be 
cpfimon (generic) to R/B&I systems From these key variables (features) we 

developed the comparative analytical framework which we are now describing. 

■ ■ ■ ^ " 

In turn* this .framework was used for a more detailed and systematic, examinatloa 
of severa'l sector's and of several features (and sub^parts of features) . 

The above process, though described in ratljer linear faahion, was quite 
iterative ~ with each part of the procass being repeated Beveral times 
as new inslghta and understandings were gained. For ease of preaeritati'on 
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here 
the 



'we will ginerally usa a step-by-step descriptive progess which reflects 
Result of these iterations - - . / — 



le EmergeTit Nature og Real -World R/D&l Systems 



It is important to note at the outset thatt ^ ''real-world" Rp&X system 
emerges as an interactive" "wording out'' of generic R/D&I chkracteri^s tics 
withirt a specific sec^ltal context,, whether by deliberate' des ign or not, 

_ ^ f / ' : \ -C - 7 . . ^ .1 

.ThuSj -^bojth the Researcher and the decision makers must under at and^ that R/D&I 
system features , is sues ^and" managemenc'^pcf'l^ will have both 

genet^ic and sectoral dimens ions and that these will all be in interaction 
with each other/ ' J M ' ^ " ' ■ / 



For the dectsion mak^r, the importance of understanding this "emergent" 
nature of R^D&I systemt is threefo-ld/ 

1., An understanding of the generic charWcteristica of R/D&I 
systems enables t'he decision maker tb "zero in" on the 
I areas *of the sectoral contixt where /the critical issues 
are likely to be and where in-depth/ analys is of the 
sectoral context is needed, 

' . * 

2. 'An understanding of the nature and I uniqueness of one * s 
sectoral context provides a basis tor learning from 
R/D&I systems in other sectors and for dete^ining the 
adaptabilfty/transferability of ki^'owledge, methods, 
; ■ ■ bechnlqueSj innovations , etc. , frorn R/D&I ' sys timp in 
. ' " other, sectors, ^ . p 



3, From an understanding of the interac tion between generic 
' , And sectoral . characteristics , the decision mak%r has a basis 
I for developing policies and s trategies » which are both 

generlcally *funccional and sector-spedif ic, ■ ' 

. 17 • ■ — ' 
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the purposes of this study, the *'eTnergent" niture of R/D&I^ systems will ' 
allow us to inake croas-sectotal comparisons of R/D&I systems * Tp the degree 



that R/D6eI systetn i5sue,a 



BBQ%ovm ^ we may Identify gene 




sties have conmnon aspects across 



keristics of R/D&I systems < Contrarily, 
to th;6" degree that RfB&I systeift issbes^and characteristics vary across sectors , 
'we yill%ave begun a description of the sectoral R/D&I systemicharacteristiQs * 



^e may further nJte that this "etnergent" perspective permita both deductive 
^ and Inductive analysis. That is ^ we'may start with the generic understanding 
of th#R/ DM" context (i.e., the features) and through interactive , analysis 
with the sectoral conteKt', identify '*real»world*Mssu6s ^ policies, strategies* 
Or conversely, -we may analyEe a "real world" issue polie^.br strategy (e,g.: 
the impfct of specific program selection) in the light of sectoral and geri- ^ 
eric ,R/D6eI system characteristics. ' > 



4 ■ S o me" Ke y Te rm i n o log y 



It ^ill be helpful at this point to introduce^ briefly some key terminology 
kWeK^ill -be using ^hroughout this report. We will save ^full^r explication 
1 for uater * ' / 



Sec tor 



A field of interrelated activities /Institutions (e. 



^Jiealth; industry; aerospace; law enforcemerit; education) which is 
identifiable as such for practical purposes (e.g.; for funding, policy 
decisions, analysis)'. . = ^ 



Of course, there will be sub-sectors within ""a sector (^e.g.- the drug 
sub-sector of the/health sector), ' Also, there will be ins titutions ^ 
which may span several sectors (e,g/; eoiranunicatibn equipment for 
several sectors). ^ ■ - . 



Thms , definition or delineation of .a ''sg^ctQr'* ^may vary acco*rding to 
thd=p-r4^tical purposes ol: the policy maker^ researcher- etc. 
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S« Featjure An identifiable aspect of the to tal. "R/DM process 

which is useful fior analytical and/or decision niaking purposes (e.g^: 
the 'R/D&I ^systaTn''s environment; th^ parsonnel ba^a; the \gtwork of 
/institutions; research; development; dis'seminat^ion; utilization; etc.-). 

'C. Function A specific type of R/D&I system a^ivity which deBcribes 

^^what the system does .to produce and utilize knowledge and which may 
&hus be considered kn integral part of a total innovation process (e,g:^: 
developinent ; implementation). The various functtons forma sub-set 
the total set of ' features . ^ 

D. Issue ; — A specific aspect of a feature which is of concern to 
the resea^rcher, analyst^ policy maker or decision rftaker (e*g.: "sDurces 
of/'^inf otmation-* as a specific' aspect of thg information flow feature)* 

E, Context ™ The total sat of features which provides an interactive 

framewDrk .within which a feature or an iss/ua must be analyEed. Thute , for 

/ * - W *^ " ' 

example* if a s^pecific function (e,g, : ; .d#t^,e^ is to be analyzed'^ 

' its context would include all otHer featums* ■ . . . 

t ' ^ J' ' 

5, A Thaoretlfial Framework as_ an Accass_ to Analysis . ■. " 

It le important to understand that all R/DSI terns consist of a complex 
variety of f ektures which must be understood individually .and in interaction 
^ before a full understanding of an R/D&I system as a whole can be deve^^ed. 
It ia this very cdtoplexlty which makes necessary the development of ajl analytica 
frameworic within which this complexity may be analyzed. At the same time,, 

we must emphasise that the analytical'^ framework we are presenting Is , precisely , 

. . .. • ^ ^ ^ = ■ \. ■ ■ . , 

a tool for analysis. Thus, i# presenting an analytical framework , we make no 

claim for its completeness , absoluteniB&T'^ or def inltiveness Rather^ in its 

.form and content ^ the analytical framework is presented as a useful way of 

gaining access into an analytical process ~ not as some esoteric "model to | 

end all modfels", - , 
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Specificmllys wa would note the following, 

' ■ . . . ^ : , = . 

The Listing off Features . ' ' ' 

We have selected nineteen "featuras" to form the basis of an analytical 
framework , Different names could be giVen. to these features; different 
features could be emphasized ; slightly, different todifiSatidhs of the 
nature of a feature ' could be maH.e ; other features could be added. . Indeed 
we assujne^that a different listing" of features and/or issues will at times 
be us^ul as new insights are ^ined and/or as features not included here 
have ^si^if icant relevance to a specific analysis bp policy issue. The 
fJBy we Have categorized the features should facilitate such modifications 
in^the total list, of features* ajid issues^- ; * 

' " ^* R/D^I System Conf iguratidns , 

iln ^presenting our analytical frameworks ^e will use a linear array of 
the R/D&I process, Thls^is done solely for ease of prepentation, As_ 
will be seen J we fully redognize^ (Indeed ^ we; emphasize) the inter - 
. active^ often non- linear . nature of. the different fektures (both in theory 
and in reality) of the total Process . Thai array of features (and 

in particular the functions) prissented here could be re-'labeled, sub- 
divided, cliysteradj organized in parallel streams, connected with various 
feedbacks and cyclical loops, etc. thus ^ *our use of a linear array of 
features is SLttiply an artifact of p res citation — and the reader 
should tteat it as such. 



The Configuration of Functions: An -Emar gent Dependent Issue 

.It^.wlil perhaps be helpful here to carry this discussion of configu- 
rations a little fiurther, specifically x^;lth respect to R/D&l system ^ 
functions • - , . ' 



A variety of configurations of .R/D&I system functions is not only 
/' possible such variety ^ctually^ exists in aa indeed may be mandated 

by the specific nature of the environinent and operative' syitem conditions' 
« exlsting'within a'^specl^lc sector. Thus ^ in some IristanceSj we might 

find the various functions rather precisely ^^gmented. In other Instances 
we might find the various functions rather precisely slgment^d , In yet 
other instances 5 .we might find the entire R/D&I process oceurlng within . 
: a single institution^ f or even within /a single person. 

Further, we ttiight find R/D&I -systems interacting with each other. Thus, 
a specific real^world organization (e,g,i a ^mderal R&D laboratory;^ 
a book publisher) may play roles in'steveral different sectors (e^g.: 

health; energy; etc,), ^ 

' . ^ -- ^ 

Thus, while we utilize a linear array of R/D&I functions for purposes 
of presentation, we will treat the conf iguration/of functions as. an 
emergent dependent Issue* ^ , , . ' 

III, R/D&I SYSTEMS: ^ SECTORAL DIFFERENCES AND GENERIC .COmQNALITIES 
1, Defining a ''Sector" - ' . f 



We= have up to this point identified a ''sector" in terms -of a somewhat vagu€ 
(but. hopefully somewhat reasonable) concept of a "field of Interrelated 
activities/institutions" (e,g,: the he^l.th field; the education field; 
the field of Industry; etc*)' The typical question we will be posing is: 
How do R/D&I systems vary across sectors? 

There are- several problems with this question. We lack any substantial 
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basis for knowing how or why to di'stlnguiah one sector from dnother -- and 
there are very, obviously also major differences within what we call sector. 
ThuSs therf may be greater similarittes between some of the regulated in- 

• dustries and various goverhinent agencies th^n between regulated industries 
and other industrial firtr^. Service firins dperate in quite different ways 
from manufacturing firms. Some hospitals are private for profit; others'' 
are public. And so on* If we take a purely empirical perspective and eKamine 

/the systems across the comm6n^ differentiated sfetors (industry, 

healths educations etc.) we quickly incounter the problem of having to deal 
with .many. uib^xplalnabVfe yariances within sectors and across supposedly /similar 
sectors. We also encounter .simllqrlties across ^supposedly dlfferen sectors. 

^As. we attempt to unraveL these a^omalle's we. inevitably move toward the us^ 
of mora cpmplaK typologies gf organlEations ^ aectore, products, personnel j 
etc,, specific recognition of historical developmentai phases; consideration 
of diffeto^ences in the state of knowledge and technology; etc. 

Indeed, precisely because the .definition of a real-world '^sector'' is 'an 
imprecise science , it is necessary to take into account the various compleK- 
itles- involved. Utilized in its fullest possible way, the analytical ' frame- - 
work we are presenting would merely take this process of ever-increasing 
complexity to its logical conclusion. Needless to say, we are not advocating 
such an^nfeasible ultimate strategy, 

2i The Necessity of ^ Sectoral Basts of Comparison*. 



To abandon a sectoral basis for comparative analysis simply because of the 
inherent degree of vagueness and complextty might be theoretically interestlnf 
It would not be useful. 

SQclety is organised and operated within such sectors to an important degree. 
If we are to be helpful to policy makers , managers and other participants 
we must be able to relate ourselves to the affairs of such speci-flc sectors. 
Thus j our objective will be to attempt to understand, iuz. relation to any 
specif Ic . Is&ue under investigation, what comjjlex .of contextual conditions 
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has what impacf; and to which sector (or part of a sector) such a complex 
of conditions can be. associated 1 , ' ^ 

We do^not, for axample, mAke the a priori assumption that the R/D6^I flow of 

personnel- will vary across' all systems , or at ^11 times within a sector 'sbch 

as healthy education, ag^rlquiture ^ industry^ etc. Rather we wish first to V 

know .what contaKtual cond it-ions influence this f low^ and the-n to -deteri^ine . 

in what ways seqtors, (or parts of sectors vary across. th"^se contextual' 

' ' - ' - ' ! / ^ \ ■ ■ = 

conditions, - ^ ' ^ . ' 

In this way it will be posslBLe to explain why similarities and, differ- 
erices in personnel ',flow appear across and within sectors. With this per- 
spiactive we can also now hope to address ourselves to the question of how 
and why differences do appear for a given area over time, Ine'^itably this 
ma^es the proceas of comparative analysis complex ^ but ^ we believe , for 
the first time feasible, \ P 

■ ^ T ■ _ ^ 

3. Existing R/D&I System Variations ' " - ~ ^ ^ ^ ^ 

In attempting to develop a theoretical analytical framework for R/'D&I systems 
one is immediately struck by the timnense amount of observable vatiety in . 
real-world R/DM syst;ems. Existing R/D&I systems vary in such matters a^ : 
clusterings of functiohs within a single organization (or even within a 
single organizational unit); eKistence and strength of institutional net- 
works; overall level of system maturity; suscepti^^ Ity to political 
influence; types of dissemination mechaniims and ^^fetegles ; - use and »^ 
effectiveness of various management technolo 



ts andf^^t 
gies; 'Itc, 

R/D&I systema vary across sectors. Thus, for example ^tehe R/D&I system in 
aerospace differs significantly from the R/D&t s-ystem ffl education. Rut 
the ispues are complicated e^ven further bfcauae R/D&I systel^s also vary 
within a single sector* Thu6 ^ for example within the private industrial ' 
world we encounter rather dLfferent R/D&I systems for the oil and TpV* 
industries. In health, the R/D&I systems for drugs and surgical procedures 
will vary. - , ^ ^ " ■ . - : 
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A. .Illustrations of -R/D&l Sys tem Varlationa . Aq ' 
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To illustrate the kinds of problems and ^IsaMlttfaat- iari^se from such 
intra/inter-sec£o,,ral variances^ let us look ve.ry br£ef ly at 'the ways in ^ 
which R/D&I functions are organized (in grouping's -oi^ ^^epar^tely) in the 
= realrworld institutions which are td be found in the-^ varlpu$ 'sec tori 
i.e. J comparing liow a variety o€ functions .(research^ deVelipment, dts- ^ 
serainaEloh, etc.) are encompassed in single or mul t Iple .\oiganizations or 
organiiat^onal units , ^ and* how this differs across sectors ./^ Given cHe. fi 
present conce^within , education with institution buildt%/ this -would # 
seem to be ah,, important" issue for educational R/DM./ • ' ' ' ' 



yiB will briefly look at the organization of functiomg in the' following 

three sectors: ^ ^ ^ ^ ,. . - ^ , 

1. Industry ^ specifically the civirian aviation Industry; ^ 
2,1 Healtli -- spec if ica 1 ly " the drug field; 

3- Education spec i f teal iy the curriculum and materials area/ 

In the civilian ayiation industry thR R/D&I sysr.^m is organized in a 
relatively linear, f unc t ion= t o- f uric t ion procesH from ba's ic' knowledge 
production ( KP) to knowledge utilization (KV),_ The 'R/D&I system is 
relacively highly di f f erent ia t ed and each organizational unit or depart-^ 
ment 'is h igh ly special ized , The stages of, the R/D&I system are well 
de^valoped and cliarly defined^. \ The functional clusters tofbe obaerved 
are those built around adjacent sets on the KP to KU continuum. 

rn^the dTug field \m do not find such linear, f unc t ion- t o- f unc tion organization 
Rather, we encounter' *'loops**, w^ch funucions froin the knowledge produccion 
stages being ^ associated wUh production, imp 1 ementfa t ion and utilization 
funct ions , . al 1 within single organ i iiatl ons . Most specifically, medical 



p^raQt it loners" are fDund having significant roles and Influance at many 
stages of the process, - ^ ^ 

In the world pi educations and specifically In .curriculum and materials 
development and utilization, we oba.0fve a system that is characterized ^ 
by highly diffused arrangements of R/D&I functions* Thete is a consider 
able amount of grouping of functions to be observed, with elements of 
appllBd research sometimes linked (sometimes n©t) with developmeat/ and 
utilization* ^There are often gaps, with R/D&I functions being subsumed 
(but not articulated) into other functions. 

. Some Additional R/p&I System Sectoral Va riances 

R/D&I systems frequently are not sectqrally ''pure''. Thus ^ a specific - 
organizatton may be playing roles for a number of fields. For exarrtpXej 
a publishing company may be involved in producing materials, Msed in the. 
worlds of health, aducationj law enforcement and business. Such sector- 
spanning inst^itutdojis may play an important cross-^sectoral llftkage role, 
as well as playing the specific role that they do in a given sector. 

We may also note that a given sector^ may contain several relatively 
distinct R/D&I systems* . 

f 

4_. Comnonallt leg Among Ex Is ting R/D&I Systems 

In spite of the immense amount of observable .variety among existing R/D&I 
systems, these systems nonetheless do aly s^em ^tp eKhlbit cotmnon character- 
isttcs characteristics that imply 'the eKlstence of generic features 

of R/D&I systems. 

From a broad 5 overview perBpective, we may note that all R/D&I systems in- " 
volve some rather basic, common functions, such as research, development, 
production, disseminations utilization,,. etc.c,^,The specific form, manner or 
configuration of these' functions may vary across sectors, bu.t the functions 
themselves appear to be inherentrin the overall Innovation process of an 
R/D&I system, ' 2 5 » ^ ' 
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^ We may Juf thfer note that for any single R/p&I functlott, there appear to be / 
characteristics which are common (i.a.^ generic) to that function bDitli 
across and within sectors* For eKampl^, the basic researoh function Involves 
a high levei o| unGertainty and ^unpredictability ; involves extending the 
litglts of the eKisting state of the ar^ (a criteria fo^ "eKcellence" in , 
basic researcfi) ; of teni- irv^fllyes a long time^llne (10,20/ even 50 years). 
These characteristics , if Indeed generic 5. hive strong implications for 
policy maklngVand management in R/D&I systems. " / ' /' 



In contrast, the function of developmerit Involves a significantly lower 
degree of uncertainty and unpredictability; is concerned with utility and 
''product specifications" d^nstead of ''ultimate'^ qualities; requites less 
highly speciallEed and more interdisciplinary personnel; and generally * 
tends to have a short to moderate time-lin& (usually at least 3 to 5 years, 
sometimes longer). These characteristics, if Indeed generic, will have 
strong implicatl|ns for policy making and management in .R/D&I systems 
but the Implications will be significantly different from the implications 
relevant to b/asic research. Further^ these^ differences between the b^sic 
kes^earch^_ and development functions (and other functions as well) will have 
-stnpng policy making/management implications concerning .the integration/ 
coordination/orchestration of the various R/DM system function^, - 

5 t Secto^Vs > generic : ^ The Need Fbr a Framework £ o r Comparat Ive Ana.lysis 
of R/D&X Syst^s ' ^ ' ^ ^ 

*^ . ■ • 

The discussion thus far begins Co indicate the type of questions and Issues 
which are important to policy making and management in R/D&J systems , For 
example : ' ' ' . 

How can we identify when cross = sectoral differences represent slg-- 
. rilficant gaps and/ojr inappropriate states (i,,e., the absence or 
wrong ap^licatiDn of ■ key generid aspects of R/D&I) and when 

do these differences represent reasonahlo adaptation to speclfi^c 
Sectoral contexts? u - . ^ 
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why do certain management approaches (e.g.: PliRT) seem to work " 
well in' one sector (aviation) and poorly In another feducation)? 
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What policies and managaraetit approaches are most approprlata to a 
given R/Dfiel function^n a^paclf Ic sactoral conteKt? * 

To answtr suefr questions , it 'bacomaa naeassary for is to try to Gndaritatid 
'how the requir erne tits for R/D&I systems emarga from the intaraction between 
generle charactartstlds of R/D&I syB tains on the one hand and the spaGiftc 
sactoral R/D€iI confce^ct on the othar hand. We must than try to understand 
how ganaric coirmonality and sectoral variety in R/D&I systems lead to 
varying policy and inanagament issues and requirements withtri and 4c ro^ 
sectoral R/D&I systems. 



Developing such an undarstanding has come to recognized as one ofSythe 
most critical needa of innovation itudies at this time* In a recent re 
view of current knowledge on technological innovation^ Kelly and, 
have commented (based on the commissioned contributions of a dozen 
researchers in this field)* ' ■ 9k 




"The literature on organized innovation consists largely of narrowly- 
focused, piecemeal, non-cumulative empirical studies. Hence the complex 
interrelations among organlEatlonal' structure ^ funGtlons an^ orientation 
toward RSeD are not we^ understood , ' ^^S-S.^ 

J • ' ■ ' " 

There is a critical' need for higher- level, f^ntagrative theories 
and models which can guide the empirical studies and lead to 
cumulative results, both explanatory and normative. We see an 
inmediate need for an itaratlve, interactive L4 lonshipdbetween 
theoretical and en^lrical research*.*,". 



6_» Three Central Questions of thla Ary lysis > - * 

Prom the discussion thus far, it becomes obvious that sre are really 
three basic questions around* which this analysis is ^ must be) focusedi ' 

1* Can r/TD&I systems be described In generic tatros? 

^ 2g Can an analytical framework be developed which will enable 

us to idantify and dlf f erentlata between generic and sectoral 
charaetariitlcs of R/D&I sys terns? 
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3. Will' the aiuiiytleal framawork and subs equant gsnerle and 

saete^al dadorlptlons %m useful to the paltey making /managemnt 
decision maken? That 1*^ ean the generia/seetoral deserip- 
tldns rbe brought dovm to poliey and managament ralevanfr-levf Is 
of deliallp aqd yet still be mappiid-baok into the mora general 
analyl:iaal' franeworlc? * . / 



( 



;hkt res 



ults from 



Real^^orljd R/D^I lysteiu reflect th# variety and temple^ity thi 
the ^teraction Qi genarie and sector-specific dynraics* ^nius* generic R/Dai 
character^s'tica ciinnot be idantiflad simply by cataloguing real^world R/P^X 
InatitutionSi proc:asses^ chai^actaristicSp issues, .etc. — no^ by craating 
eoplricaliy based models of k/D^X aystams. Both processes lack meahanisms 
(analytical framei^^rks) with which ^to distinguish between that which is genaric 
from that which iii sectdt-^^fepcif Ic* 

^Thus, what is needed is such an analytical framework^ which will allow on^to 
distinguish^ betwefn the generic aiAd sectors-specific characteristics and Issues 
of raal-^world RfiSJl systenS, This framework must recogniEa that the oontaxt 
of an R/D£il system is the product of a complax interaction of all ayatam features 
and of generic and sectoral dynamics. 



A framewot'k which | included a complete description of all possible contextual 
feature^and Issues (and their interactions ) would be quite complex — and 



far beyoBd the scope of this study* Nonetheless, we shall attempt to provl^ 
the outline of such a fram^wor^^^nd provide some illustrations of Its usage. 

In light of the above coiranents ^ we believe that a cross-aectoral method of 
analyaia will provide an analytical framework within %rtitch generic and 
sectoral issues may be identified; differentiated and illustrated in a 
manner useful both to^the analyst and to the daclsion malcer. 

It Is to this task that we now turn. / 
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IV, A F^tEWORK FOR COmARATI\m ANALYSIS OF R/D&I SYSTmS / ^ 

1> _ Th^ Fsy^B^cttve of General Systems Theory ^ - . ^ 

~ . ■■ . . * 

The fratojework presented here for the analysis of R/D&I systems has, been 

drawn' from the general systems theory literatures as exemplified by such 

(3) (2) " ^ 

authors as Ludwig Von Bertalannffy % and James ff* Miller- * Without 

attamptlng to present an exposition of this perspectives we. simply note 

that wa Have adopted the central elements of their framework for descri 

the stTOcmra and functlDnlng of living systems i \ 



Thus 



, we wl^ 




attempt to analyze R/D&r systems in tems of how they interact 



i 



" with their anvironmants | their eetitral elimants or sub-systems; the, m^chaniatns 
that link them together; interBal system structures j Input-output systfems 
as well as such other systera conditions as age and state of developmental 
maturity V \ . , 

A > Bystgm Definition 



An important question is that of system definitions What is to Ue cpn- 
sidered^ within the R/DSI system(and within which part of the system)] and 
what is in the enviroTOient? The framework we are presentitig does not 
contain abrupt boundary notions. What is considered within or exteTnal 
to the system is a matter of degree and will depend on the focus and 
purpose of the analysis* Furthers a^i R/D&I system may be^ '*defined^^ 
either broadly or narrowlys depending upon the contextual situation 
and. the needs of analysis. In the broadest s^se^ % particular R/D&I 
'^system" may (for. practical purposes) comprise most of a sector. In 
the narrower sensis a single Institution may rfncompass virtually all 
aspects of an R/D&I '^system*'. In the latter instances we may indeed 
find several institutional R/D&I "systems" existing within (and being 
a part of) a larger R/D&I -'system'- within a parpicular sector. 
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Th® critical point to ba note4 hare is that the framework for com* 
parativej analysts p( R^D&I systems being suggested here is not^meant 
to be limited Ito a rigid conceptualisation about boundary notions, 
B±mm QT scope of what la/is not an R/DfiiL system. Rather the defi- 
nition of. the relevant R/D^I systems (as is true of all other aspects^ 
of the analytical iramawork) Is based on creatlrtg an opportunity to 
frame key que it: Ions related to the focus of the Idsue analyjes. relevant 
to. policy/ decision makers and researchers* ^ 

^. Irtnovatlon and Operating Systems 



While we have Just notad that we do riot want to imply rigid boundary con- 
ceptions of what Is and is not *'wlthln" an R/DH system. It is equally 
important not to make the 'boundaries of an R/D&I system so brQad and/ or 
vague that the R/p&l system includes "everything" (and thus becomes a , 
meaningless concept). Thus, it is important to distinguish between those 
aspects of a sector which- deal in some way with a process of Innovation 
(and thus are a part of a total R/D&I "system") and Aiose aspects of a 
sector which are not Involved in a process of innovat 
not part of a total R/D&I "system"). These latter as 
may vbe called the "operating system"* Nevertheless ^ 
aware of ways in which the "operating" system affect^ 
the"^ "R/D6I" system, ^ ^ 



ion (and thus are . 
pacts of a sector 
Iwe will need to be 
(or is affected by) 



In light of the pravi^s discussion of system definition, we should note 
here that the extent ot "overlap" between the R/D&I ajcid dperkting systems 



may vary slgnif leant Ly across sectors. Thus, for exa 



iple/ the effort to 



land a man on the moon ln"*^he 1960's involved virtuaily all aspects of 
the system in the process of innovatlQn, In contrast^^ in the health or 
agricultural sectors ^ there is a ^ large operating system which may indeed 
be Unvolved at times with an innovation procass but. w^o se primary role is 
clearly at the "operational" level. 
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C, EK&ent 6f R/D&I System Linkage > 

Anothar aspect of the "system" eonqapt that must be considered Here is th6 
extemt to T^ieh Aha various institutions within an R/D&I aystam are (bir ar 
not) cojterantly and strongly linked togethar. Simply put ^ ^lle we'do con 
eide^.*k set of Institutions to comprise an R/D&l s^l^stam (becausa of the 



tolas they play within the total ptocess of -Irintfvat^Lpn) , we do not, presume 
,,^hat thay are in fact coherently linked togather In ^'appropriate" ways or 
\ that existing linkagls are strong. Indeed , the opposite may be true in 
. .any given context - - and there may be "gaps!" in the^ System's linkages,^ 
Indeed, the critical issues here ate pracisely the nature^ strength arid ' 
appropriateness of the Imkages (or lack thareQf)^^^ch'\do exist, 

' D, 'Maturation g(State of Development) ^ ^ _ ; \ 

It is important that we understand R/D6il systems from an "organic" 
perspective. That is to say, that 'th#y ^'emerge" over time, that 
^ they go through/ may be at different stages or levels of development 
(maturatfon) • Furtherv different Institutions and/ or different - 
functions within An R/Wel system m^y differ in terms of thair,respec- 
tlve stages pr level pfr-^evelopment. The importance of this concept 
of mi^turatlon may be" seen In , at least the fpllowlng ways : 

Ip The needs of an R/D&I system may. be different when the 
* system Is young and immature than when It is established' 

and, mature* ' . , - 

. 2* Since R/D^el systems^may mature (or decline) over time, 
their needs may change over time* , . 

3. Policies, strategies and mechanisms which are relevant 
for an R/D&I system which is young and immature may be 
irrelevant (eVen dysfunctional) for an R/D&l system Which 
■ is established and mature. 
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4* Furthers dtf ferant ^ollcies/stratggles/mechaM may be 
:neadad when the ^/ 06?! insjtltutlona md/ov functions are 
\ at diffefettt atagef of devalopmeSt than when their levels ' , > 

' of davelppment are "In balance"* / ^ 

We need, however , to understand. that the concrete meaning of "maturatlo^Vj ^ 
^ may differ significantly .across *iecfcors. Thus, for examples even at a 
-^^ -*^ture" stage of development we* woul4 not expect to find the same level 

of clarity and cettalnty In the evaluation research function In a social . 

science sector such as education as we would in a physical science 

sector. The realization of Inherent ^differences between sectors '^wlll 
: ^ be impo^:tant If we are tO' aMold making Incorrect comparisons of (and 

deveiopirtg the wrong expectations for) one. R/D&I system tti relation to * ' 
^ . other R/D£tl systems, ^ ^ ' 

' 5, A Framework for "Mid=l.eyel" toalysis * 

Gur comparative analytical fram< work serves to focus attantlori on a*^aome^ 
trtiat neglecfceA area of research nd analysis ^ sometimes referred to as "mid" 
^ level*' or *'mid-range" . As used harej this "mid^level" refers to research and 
analysHs which is soroawhara between the broad: ^evel of gaQaral theory and the 
narrow level of specific cases* * ^ ^ ' ' 

At the general theory level ^ ^the purpose of rasearch and analysis Is to develop 
concepts and relationships which serve to describe all situations (l/e; j theorie 
The approach a€ this levfl is to develop processes of Research and analysis ' 
which will uncover the broadly ^ganeraliaable. concapts and relationships. While 
important, general level theory. lacks the specificity ^^hidli is needed by policy 
and decision makers^ ^ ^ ^ ^ . 

At the Specif ic case level , the ^t^urpo^e of'^ research and analysis is "to discover 
and demonstrate the uniqueness of each situation, and the approach to research 
and analysis is designed specifically 'to uhcover such uniqueness. At this level, 
rasearch and analysis tends to lack bases for generaliEabill'ty . Thus ^ this 
level of research and analysis also has limited value for policy and decision 
makers, , ■ e . r* n ' 



Our' comparative taalytlcal fraJftework utllizas a disciplined conf igurative 
Mpgpach that will permit systematic comparison of various aectors or poltay/ 
strategy Issues • ^ The purpose Is to develop appropriate areas of generalizablllt 
which allow one to takfe into accoimt the imiqueneas of spaclfic situations. 



3* Describing R/D^sl Syatema in Tarm'g of Thetg Inter^etive Features 

Jn developing a thaoretical framaworkp ^a have' Identified nineteen key 
R/Dlil system features which we believe will be helpful, both to the 
researchar and to the decision maker (see Figure 1)* Fof simplicity of 
presantatioas we have grouped, these nineteen features into the following 
categorical framework (using a general systems theory approach) * 

1, Tha R/D£tl System -s Envirbmnant 

This catagQry will include t^osa featured which are external 
- to the Ry,D6£l system itself j but which may nonetheless 

Impinge upon and affect the system and, alternatrively , 
' which the R/DM system may affect (e^g*: social , l^galj 
' political J economic, technological environments). 

2* Operative System Conditions ^ ^ 

This category will include features' Internal to the R/D&I 
system which affect the Way the system operates but which 
ar^ not activities by which the system creates or utilizes 
know la 

dge. These feat ures will thus include general system 
conditions (e.g. ^ historical developmant) , aspacjCs of 
V system management (e,g,- administrative processes) and 

i = system inputs and outputs (a . g , r personnel base) . 



I 



Typical Comparative Features 



!• Enviraamenta of the R/Dai Syateai 



CONDITIONS 



EKLC 



2* Historical navelopment 
3. Institutional Base (Network 
.of Institutlpna) . 



SYSTEM J^AGEMiNT 



4, Goals, PoliclaSj Strategies 
5# Adminlstratlva Processes 



SYSTEM INPUTS' ^AND 
OUTPUTS 



6* Personnel Basa 

7 # Funding 

8, InfQrmatlQn Flow 

9, Innovatione 



III. R/Pai FUNCTIONS. .^ 



10, Need Identification^ -^r^ 

11, Generation/Rasaarch 

12, Development ' = 

13, Production 

14 , Marketlng/DistributionyDis-- 
semination/Diffusion 

15, Acquisition ^ 

16, Implementation and Utilization 

17, Support Servicef ' 

18, Evaluation Research 



IV. 



R/D&I RESEARCH 



19, Research on R/D&I 



Figure 1 ^ 

Comparative R/D&I System Features 
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: 3 * R/DM FuncClons" . ^ . . ^ 

' . This category wlLl Include those features whleh we would/ 

consider to be an intearajl^ part of a knowladge production 
to kaowledge utilisation process continuum ^ i,e*j what 
the system €}oes to creata and utlXize, knowledge * " 

Additionally, we have included an ovgrview featurar Rasaarch on, R/D6el* 
This will include any kind of research done about any aspect of the. 
system (any of the features or faatura issues; any eramant of the system 
such as a particular institution or set of institutions; etc,)' The 
results of - such research^ in effeetj provide the data base for analysia 
of the other features . , . ' ' - 

^ * ' ■ /V ' _ 

Within each feature ^ a number of ralevant issues may be identified. An 
expanded disctission of these nineteen keyiR/D&I features and illustra- 
tive Issues ^ associated with each feature is provided in Chmpter Two, 

^ - . \' * * • - 

A different listing or arrangement of features and issues could, of course^ 
be developed as we noted earlier. What Is important is to reeognizej 

identify and analyze the gotlentlal or aotual effeets these various features 
t|ay have (separately and/or In inter-action) on the total^ R/D&I~ system, 

4> The ConteKt of an R/D&I System ■ . -/ 

Taken together^ the totality of the R/D&I system features and Issues forms 
an Interacti^^ conteKt In which analysis and decision making muat be performed « 
The way an R/Dil system has developed over time In its sectoral environment; 
the types of Institutions that have emerged; the character of the work arid 
technologies; thp personnel involved in each of the functions and Institutioni 
etc, all contribute Interactively to the totality of an R/D&I system's ' 

context . . _ 

^ - do 



For axmple^ how an R/D&I systeim Is atructurad ^111 ba influancad by such 
faetors as the soclalj political and acohoffllc anvironments of tha InstltutlDns 
that aanstltuta tha R/DW ays tern; , by tha drngrmB of symtrnm Inititutlonallzation 
by tha nature of tha work to^ be parformad; by the hlatory and sta^a of the 
iyptam' 8 development J by the nature 'rt the system' s personnel basa; etc, 
But in ti^rn , thesa same variables will alio be influancad by the stTOctura 
of the R/D6tl ayatam. Such 1^ the Interactive nature of the R/ DM system 
contaxt each R/D&I system feature acta both as. an' independent variable 

Mas part of the total aystem context, affecting the other parts of the system) 
and as a dependent variable (^ich may b^ a {ocal concern, for analysts and 
decision makingjT"-^ ^ " ^ 

In any ^y^n instance ^ analysis or decision making willj of coursej b^ 
focused on^^ome subset of contextual features or Issues (or even on a single 
feature or^-a single issue of a feature). Such a narrowing of focus Is 
necwsary to bring the analytlcal/decisidn prpcesses down to manageable 
and meaningful levels, indeed ^ It ig important to recognize that each 
feature has Important characteristics which do distinguish one feature from 
another differential characteristics which often have Important implica- 

tions for both analysis and decision making. 

However 5 the consideration of any single feature (or Issue) must take into 
account the 'interactiqn of that specific featute with all other features 
i*e*s one must , consider a single feature or i*ssue' within the richness of 
Its total context* To try to analyze any single feature (or issue) without^ 
considering its contextual interaction would not only be inadequate it 
woii^Ld likely be quite dysfunctional ^ leading to wrong conclusions by the 
analyst* and to wrong decisions by the decision maker. Such is the inter- 

dependence within an interactive living system, 

■; ;" ■ ^ . \ . ^ ■ ' \ / " r 

Therefore a context has to be understood as the intarsection of the effects - 
or Influences of each of the system fasture^s , If we wish to understand- the 
character and managerial requirejnents of a given feature or issue (e.g.: the 
personnel base) it will be necessary to view this feature against the back-,. 



ground of all othar elements or features of the system in ^^^^ontext. By 
trie saine token. If We are concerned with a aub-issue withii^fhe personnel ' * 
base feature (e'.g,^ the flow rate of certain ty^es of personnel in andL out - 
, of the aystem)^ then we would also hwe to iTOlude all the other aspepts 
of Jth^ persoimel base feature *<ey,g, ■ ^^the types and levels of professionaiiam) 
as *part the relevant contekt for that sub'-issue, ^ ' ^ . 

5 i A Frame wo rk _ f o r_ _a C omp a r ative .SegtoralA na JLy s 1 s of A/P&J_Sys terns 

In order to identify and differentiate between generic and sector ^specif ic 
characterst ics of R/D&I systems j itpis necessary to do a croas^sectoral 
comparative analysis of R/DSiI systems within their various specific sectoral 
contexts. This we will dp illustratively in the lat-er chapters of this : 
report. The literature on R/D&I and the extensive research eKperlence of 
our research group at diSST apd Northwestern University relevant to ^/D6el . 
will provide the baslc^^ata for thls%comparat;ive" sectoral^ana'iysls • 



However s we must first prbvide a framework within which to do puch a cross- 
sectoral comparative analysis. We have' already discussed the basic ' elements 
of this framework:" jfeatures and issuea, context ^nd sectors. It is now 
the^ task to describe how these elements can be brought together to form a 
cpmparative analytical framework. This w® will do ,in a step-by-step faahion, 
and we will disttngiiish between the comparative analytical frameworks useful 
for researchers and for decision makers, ' " ' ' j 

A, A FQ_cu_sed Process of Analysis 

To attempt to analyze simultaneous|y all R/D&I system features , char-- 
acteristlcs, issues, etc, would 6e impossibly voluminous and complex 
even ^within a single sector. Similarly, it would be impractical to 
atten^t art analysis of even a single feature across all possible 
sectors. Out of sheer necessity , it would be necessary to narrow^ the 
focus of analysis. This may be done by focusing Ion a specific R/D&I ' 
system feature or issue across a selected set of sectors. This narrowing 
of focus will enable us to identify the Important characteristics of an 
R/D&I system feature or issue, . 
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: pteacESs for 

NARRCXJINfl TOE. FdcUS 
... OF ANALYSIS 



ILLUSTRATION 



^* Select a feature for 
, aoalys^ls which ±b 
-relevant ^'to the general 
area of .coricarn, 



Fetftures 



. 18, 



Ens/lronmaht 

Historical Development 
Ins 1 1 1 u 1 1 ona 1 _ Ba s e 
Goals, 'PollclaSj §trategles' 
Need Identification- 
Evaluatldn ResearQh 



List relav! 
of the saletfted feafc 

_ ^ 

Select ia 
which willf*fi, 
' tribute moB&i 
general .area 



Issue's l&w^'i^^^ 





Institutlonar BaMe - - 

Institutions ^ ^ 
Institutional Eotffs 
Institutional ,Cbarac£eristlos 
System Structure. 

System Configuration ^4 
^ Inter-Ina titutjorial Llnkagea 



4* List relevant sub-issues 

5, Select sub-lssue{s) which 
win likely contribute 
most to the general are 
of concern 



... / 
6* Analyze the sub-is4ue° 




Institutional Base 
Syitera Sti^cture 
, Inter^Instltutlonal Linkages 
Linkage Characteristics. 
Interface Structure 
^ Linka ge Consequences 




Institutional Base 
" System Structure,^ 

Inter- Institutional Linkage^s 
Linkage ^Consegjiencej 



Figure. 2 illui'tratesjhow the focui of afiarysls may be narrowed in sue - 
. ctsatVe, stipa uottl a level of analyils Is raached where the anaiysis; . 
ta^ refftciently narrowed to be feasible yet still robust enough to permit 
, meaningAl analysts* Thus , the proeess narrowing the focus pt analysis 
^ tmprpves^ the "resolution" of what initially Is likely to be a somewhat • 
vjagu05 "blurry" picture of a general area of concern about R/DSsI s^jstems. 
Of course, how brpad or narrow the focus of analysis* should be depends 
upon^the purpose of the analysis, ^ . ' / 



^ B# A Cutmalatlve process of Analy^is^ 



Obviously s the analysis of a single feature or li sue would not give 
us a fulfl picture of R/D&l systems,^ Thusj separata analyses must 
be made of a range of features and Issues .analyses which though 

done separately would cumulatively provide a fuller picture of R/D&I 
^ystMs. Ct^ulatlvely J these separate analyses will ejiable us to 
iderittfy similarities and differences (a) among the features and (b) 
across sectors. Which and how many features and issues (and in how 
many sectors) are to be so analyzed will' be determined by such' fac- 
tors as: tlme-vllmitations; availability of data; the Interest of 
. the *Msearchers 'analyst, or the decision maker; or th^ spi^ci^c pur- 
poses for which an analysis Is needed* of coursej the ideal would • 
be'cumulative analyses of all possible features and Sfasues across -3*1 
possible sectors f»- , but as this is unrealistic (atjd prqbably not 
necessary) J selections must be made, . . 



Interactive Analysts by .Context 



Havlj^g chosen^ a feature or Issue to analysi comparatively across 
sectors, it is necessary that the analysis be done as^ contextjial 
analysis. That Is to say, whll« any given featfure may have i^a owA 
particular characteristics , the f eature is part of i an interactive 
'System, Each feature affects and Is affected by §11 the other 



tures (1,©;! context) of an Intaractdve'R/D&I system nb 
simgla feature can be adequately ui^tstood apart frott Its. inter* 

action ^Ith the othar %stem f eattfMs . - ^ ! . 

- ■ " ' •■ ^ , ■ ■ . . ^ ^ t = . . • ■ 

The intaraetion involvad in a cpntaxtual analysis ' has a yery Important 
rola* In essanee, it kfeaps the analysis of a lelaet^d feature qv isaue 
In proper parspective relative to tKe overall picture of the R/DM 
systeia.. %it guards agatnat the danger that the feature or issiie' being 
analyzed (which Is only a part of the total rR/D€cI ^cture) toight be 
treated as if It ware laolatad atld independent,'' * 



Delineation of Generic and Sectoral Characterisfctcj. 



When a feature or issue la contextually analysed across several 
sectors s it will become possible' to Identify slndlarltles <i,e* / . 
generic characteristics) ^nd^ilffer^ (i.e. ^ se6toral character- 
istics) of the feature or issue across* sectors .t^^ this idifttit 
fipation of generic and aectoral characteristics must be :^co^iideried^ 
tentative at this point in ttme, at least the^ec will be f i^dings^ ' 
which can be subjected to more acrutinlaing analysis and empir.lcaV 
verification, « . 

E* An Iterattve Process \ , ^ 




We mdst note at this point that the comparative analy:tical- framework 
we have iust described is 'an iterative not a utiidlrectlonal 

. "■ ^ ' ^ >■ ^-^ " ' 

prpcess. While the initial flow of the process is from sectoral 
contextual eMmihat ion to* identification of generic and sectoral 
characteristics 3 reversing the process Is also important* That iSj 
the generic, and sectoral , characteristics that are identified should ' 
provide a fresh 'pe,rsp6ctive f rom which to eKamlne the sectoral- cohtext . 

' <■ y ■ ^ ^ ' ■ ' ' ^' . ' ■■ ' . r'[ ^ ■ 

This helps to satisfy the point i^ade earlier by Ktlly arid ^r'ansberg 
that we have en iimnediate nefed for an iterativa interactive re- 

lationship between theoretical and emperical researdh'H / ' ' = 



'F« Summary / ' ' - 

Figure 3 s umna rlges the above diacussion of^ the comparative^ analytical 
fr^eFork- ■ . 

^ * -J : - - . 

6^ A^ncy Usa of the Comparative Analytical Framework 

Thus far J we have described a comparative analytical framework for identify-' 
Ing generic and sectoral R/D&I ^system characteristics. While this is suf- 
ficient for research purposes we need to^ take the process one step further 
in order that the comparative analytical framework be useful 'for the .decision, 
maker that is, using the framework to identify §nd evaluate^ policy and 
Strategy options.^ To do this 5 we simply modify the sectoral ^ .analytical 
framework (described iri Figure 3), . . . ' 

Figure 4 describes the analytical framework which would be useful for decision 
makers,, As figure 4 indicates, this analytical framework remains: 

1.. a fpcused, cumulative process of analysis (though now the focal 
point of analysis may also, include policies and strategies — 
a useful addition for the decision maker); 
' 2. an Interactive anfllysls by conteKt • and ^ ' ^ 

3, an iterative process 6t analysis* 

However, we^no longer focus on ^Jpross="sectoral comparative analysis per se 
(though of course we do. use the available crosa-sectoral comparative data asl^ 
relevant) . 

InsCead, we now focus upon an iterative analysis of: 

1^ generic R/D&I sygtem characteristics (which have been idehtified 
through the cross-sectoral process of comparative analysis); 

2, sectoral contextual characteristics o^ the specific sector in- 
volved (e,g*^ education; health); and 

3, sub-sectoral contextual characteristics ..(as relevant; e.g,: the 
drug field within the health sector). 
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Iti eseence, the framework we are now describini la an Iterative conteKtual 
analysis of one or more selected R/W«I system features, issues, policies or 
strategies in light of what is known about reliant g^enerlc R/DW character- 
istics and about the characteristics of the given sectbr (andj as relevant ^ 
of ^he given sub-sector)* , 

This framework wtll permit us to compare descriptive findings of system 
features and issues (the sectoral contaKt) with what we would expect (or 
would want) to find from the generic perspective* For example, if funding 
atabllity and its consequences for basic research Is a generic Issue for 
all R/DW systems, it would be possible to examtne the sectoral context in 
terms of potential for funding stability and to observe whether the outcomes 
for varying conditions did or did not meet expectation,- 

Management and policy options could then be generated and action taken that 
would either deal with the nature of the funding stability or with the pro- 
cedures being used to cope with the given level of stability. The process 
is dyriamic in that the policy and management actions taketJ themselves become 
part of the context-'^orming process in a feedback mode, 

7* - Deductive or Inductive AnalT&is 



We should note again at this point that the framework of analysis we have 
described may be used either deductively or Inductively, That is, generic 
questions can be used as guides ^aps to explore real=world conditions 

(deductiveX.. Alternatively^ observations or reports of real-world Issues 

- ■ % 

and problems can be traced back to .their generic roots (inductive). In 
either case J . the objective for the decision maker Is to identify policy 
options relevant to the observed Issues, take any necessary actions, and 
evaluate the outco^ne, , Thus i ^ / 
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Figure 5 
A Deductive/Inductive FraTngwork 



V. Cone lus Ion ^ w 

In this chapters we have attempted to provide a general understanding of 
the nature and utilization of a conteKtual approach to the comparative 
analysis of ,R/D&I systems* To further develop an understanding of con- 
textual analysis J we will in Chapter Two expand our discussion of the 
R/DH features which (together and inter actively) provide the total con= 
text in which R/D&I must be understood, ^ 

Chapters Threes Four and Five will illustrate how specific sectors may 
be described and analyzed contexturally . 



Chapters Six^ and Seven will then illustrate how the contextual analytic 
approach may be utilized to lead one into a detailed focused analysis of 
key R/DSI issues relative to a specific R/D&I feature* The final chapter 
will briefly overview the contextual analytic approach. In th^ Appendix, 
we will briefly Illustrate how we have already begun to^ddress specific, 
concrete R/DSI Issues through this contextual analytica^^Mproach, 
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ILLUSTRATIVE DISCUSSION OF THE R/D&I CONTEXTUAL FEATURES 
ENVIRON^ENT 



A* Political/Legal Environment 

B* Social /CuSiural Envlronraent 

Q» Ecbnonilc Environment ^ 

D* Knowledge/Technological Environment 

II, . HISTORICAL DEVELOPJffiNT ' 

- ^ e/ " - — ~ - ~ ~ " 

A, pevelopment Phases ^ - 
B- Critical Event's in the Development of the R/D&I System 

1', institutions Established ^or Disestablished) 

2. Legal 

3. Political 

4. Development in the State-of- the- Arts 
5 * Funding . 

III, INSTITUTIONAL BASE (NETWORK OF INSTITUTIONS) 
A* Constituent Institutions 

B, Institutional Roles Wi'^thin the R/D&I System 
C- Charac teriatics of Institutions 

System Configuration (Clustering ) of R/D&I Functions 
E. Inter-Institution Linkages 
1* Linkagp Gharacteristics 
2^ Linkage Structures 6c MechanisM 

3. Boundary Conditions 

4, Linkage Consequences 

Characteris ttcs of R/D&I System Structure 

IV, GOAXS, POLICIES, STRATEGIES 

A, , Source 

' B . Content 
C* Aspects 

V, AD MINISTRAT IVE PROCESSES 

'A. Responsibilities and Tasks 

B. Administrative Relationships 

C^ Administrative System Characteristics » 

D. Characteristics of Administrators 

E* Administrative Techniques 

VI, . PERSONNEL BASE 

A* Types of R/D&I Pfirsonnel: Needs, Availability ind Sources 

B. Professions anc^-^ccupations 

C. Systems Activities Related to the Personnel Base * 

D. Characteristics of the System's Personnel 

yil. FUNDING ' ^^^^ 

A. Sources of Funding 

B. Type of Funding 

C. , Level and Adequacy of Funding 

D. Stability of Funding 

E. Other Considera t tons 

So 



INFORMATION FLOW 



A, Sources of information 

Recipients of Inforraation 

C, Information Flow .Channels , 

D, Patterns of Inforfnatldn Flow 

E, Purposes of Information Flow 

F, Networks of Infdrniatlori Flow 

G, . Utilization of Information 
H* Control and Access 



INNOVATIONS 



A* Requirements for the Innovations 

B. Characteristics of the Innovations 

C, Impact and Benefits of the Innovations 



NEED IDENTIFICATION. 



C, 
E- 



What/How Need Identlf tcation Processes 
Whete Loci of Need Identification Processes 
Who - - Need Identifiers I 
When ' - Timing of Need Identtf icatioTi 
Need Identification Process Characteristics 



XI, 



GENERATION/RESEARCH 



A* Search and Knowledge Synthesis Process Characteristics 
B* Research Process Characteristics ^ - ' ' 



XII, 



XIII. 



XIV. 



DEVELOPlffiNT 



A, The Developers 

B* Development Outputs 

C* User Focus and Linkage 

D. Development State of the Art Linkages 

Linkages to Production 
Ft Developtnent Processes 

PRODUCTION 



A. Production Proqesses 

B. Characteristics of Production Processes 
MA^ETING/DISTRIBUTIQN/DISSEMINATION/DIFFUSION 



A. OrganiMtlons ^ 

B* Product Type 

C* User Characteristics 

D. Process dharacterlstics 

E. System Level Considerations 



KV. 



ACQUISITION 




Steps in the Acquisition Proc^ 
1* Awareness 

2. Search 

3. Bidding 
^ 4. Testing - 

5p Evaluation q ' 

6 ^ Purchasing * 

B. Role/ of Key Personnel in the Acquis i^to^i Process 

C. Acquisition Process Characteristics 

5i 
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IMFLEf^NTAtoON/UTILIZA^ION' 



A* 
CV 




' Imp lem^ taction Processes 
Utllfeatfon Processes ' ^ ^\ 

Implementatiori/utilization Process Characteti^tlcs 
User Characteristics Influencing Impjementaclon/ 
Utilization . - . f ; ' ^ ^ . 

Producer Characteristics Influencing Implementation/ 
Utilization v ' 

Producer/User Rfelatlonships Influencing Implmentatlon 
Utill^zation Processe.s ' 



SUPPORT SBfeVICES 



Support Service Requirements ^ 
Linkages to Support Services 
^Support Service Character Jostles 



EVAXUATIpN RESEARCH 



Two Kinds of Evaruatlon Research 
Significant Participants 
^ype of Program or project 
Design Methodology and Process 



.RES EARCH ON R/Dfiel 



* ....... ' . CMPTER TWO ' 

ILLUSTRATIVE DISCUSSION OF -THE R/D&I CONTEXTUAL FEATURES ^ ^ 

In the previous, chapter, we bam briefly discussed t^e R/Dkl contextual 
features and listad them in Figure 1, In this chapter, our intent is 
to provide some insight into tlie contextual anal^leal frpmework througl 
' an expanded* illustrative discussion of the nature] of the' features and 
of feature issuep. This will be done primarilj..^ the firmat of brief 
descriptive introductory statements and a series of queetlons about 
each feature which will illustrate the type and scope of I issues in-- 
volved in a conteKtual analysis. Hopefully, thes^ questions will sug- ' 
gest to the reader additional qu*estiona and Issues, 
, . ^ . . ^ • - ^ \ ' " ' . 

While we make Ao attempt to be exhaustive in our listing of feature 
issues (nor to suggest that our method of categorization of issues is 
the only way the Issues could be usefully categorized), we do suggest 
that a detailed contextual analysis based on these questions would be 
comprehensive. Neither do we make any attempt here to provide answers 
to the questions both because it is beyond our scope of purpose 

and because to a large extent the. answers will (and must) bp context 
specific. Rather, Chaptirs Three and Four will Illustrate ^iiow these 
questions/issues may be used as a basis or framework for trie more spe^ 
cific task of develjoplng a specific contextual analysis for a specific 
sector* Similarly Chapter Five will provide a brief illus/tratlve cross^ 
sectoral' comparative analysis of the various features and /feature Issues 



Further, in order to keep this chapter illustrative and as brief as 
possible, we will not ^in this report cite the literature references 
relevant to this ^chapter (we do cite references in othe^ chapters) • 

Rather, we will cite such references in a . later. iVolume (for which this 

i 

report will be. an input)* , j 

5 3 / 

I 



some fMrther comments „wiU, h^i,p guide the reader in understanding and 
■•Htllizing the contextual analytical framework^ represented by these 
features . , ' , ' ' . 



First, ainc^ che^^rfe differences between specif R/D&I sectors, systems 

and areas, of^oncerrr^ the reader will likely f4nd some ,of tl^ questions 

to be of more relevance^ than others,, This is to be fixpectedS different 

issues will have different; meaninga. In different conteKts -J- arid 

some issues will be of less importance than others in a givAi, s^lfic , 

context. 

■ . ■ * ' • 

Second, while the issues suggested in this chapter are in ef feet only " 
a "first eut^ analysis (not a detailed analysis), one of the purposes 
of listing these issues is^ to help the reader "zero in" on the kind of 
compleK of issues which are worth more- detailed analytical' effort . 

Third, we remind the reader that (as noted in Chapter One) the nature 
of what constitutes an R/D6I "system" may vary across sectors. ^ " 

Finally, we will generally here refer to a single R/D&I system or 
< sector. This is done for simplicity, with .the asstimption that we 
would usually be focusing primarily on a specific R/D&I system or ^ 
sector. Of course, in any case where more than one Rj/D&I system 
or sector were being considered, the questions provided in this ' 
chapter would then be stated in the plural, r . 



..^ lyary system axiafc withirt and interacts with, an environment (which will ^ 
^ have many components)* What is part of the system's environment and / 
what is part of the syatam (i*©., th^ ''boundary" quastion) la riot at 
issue here * ratharj as we have already noted , this depends upon 
the purposes of discussion or analysiSt The issue is^ What is the 
.nature and af fact of the intaractibn (actual or potential) batwaen 
various parts o£ the R/D6eI system and various parts, of its environment* 
From this perspective ^ we are concerned both with the ^f fects of 
environmant on the R/D&I system and^ conversely with^ the effects of 
the R/pfiel system on its enviromnent. And we are concerned with 
issues re'levant to the differences bet'ween open and closed systems- 

The concept of environment includes all that may be considereQj external . 
to the R/D6£l system. Thus, the concept of environment is bota compleK 
and dynamic, consisting of many parts or elements in interact iotivnot 
onljr, various parts of the R/D&I system but with each other. . 

'These various elements,, of the R/D&I system's environment could be 
described or classified in many ways. The following is one such 
classification schema which would have at Ifeast a general level , of 
cprmnon usage and understanding. We should note here that while the \ 
issue question's listed below generally refer (for the sake of - ■ 

simplicity) to the R/D&X system or sector, they may also apply to 
the institutions -within the R/D&I' system, 

A> Polltflcal/Legal Environment - 

As is true for any organisation or system, laws and governmental regulations 
consitute a significant part of the R/D&I system's environment which can sig-= 
nlflcantiy impact the nat'ure of the systemp Such laws and regulat^ions may have 
several -sources ^ at the federal level of pkrticular countries; go-^rnmental 
units within a country (e,g,i state, county, city in the U/S.)r international 
agreements. 



similarly j the R/D&I system^exiats in a political environment and is thus 
subject to political pressuraa which may differ in terms of sources, impact^ 
Intensity p etc, and which may vary across time, in different contextual situa 
tionsp Bmong R/D&I systems or sectors, etc, ^ . 

- . / . ■ ■ . : ' . . ' : , J ■ ■ ' : 

Some Important issues could Includei 

What are the^ loci of legal processes affedting the R/D&I system and sector 
(e.g.: level of government I specific goverMental agencies; courtsi 
etc* ) ^ ^ ■ / 

_ " ♦• _. . . - * ■ _ * 

What are the existing or poteni:ial governmental fegulat ions and policies re- 
garding the type of. Innovations relevant to the R/DSI system and sector? 
At what governmental level? . . ^ 

Are regulations and policies of different gbvernment levels (or of different 
agencies a^ the same governmental level) similar or dissimilar? /If dls- 
similar^ what is the effect on the R/D&l system and. sector? 



In what ways (and with what afftcts) are such regulationa and policies ad- 
ministered? ..r . : 

What are the loci of pollcltal pressures affecting rhm^R/t&l system (e.g,i 

Congress;,, governmental agpncles; lobbyists; pressure groups; etc.)? 
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What are the potential (or historical) consequences of such pressures? What 
might be <qy have been) the responses of the system to these pressure^; 

^ : ' ' . ^ ■ - ' r - ■ \ ^ ' ^ ■ ^ ' " ^ 

Are the loci of political pressures focused (i.e., from a specific individual 
; or group) or Morphous (e.g.: SDclat^l attitudes)? Are there few or 
-many sources of political pressure? ' . , 



Social /Cultural Envlyonmettt , 

R/D&I eystiira also , exists in and is ImpaGtad by the sQeio/cultural 
^eriviroraifent in which it exists, xha sOGio/eultural pnyironmeftt ma% 
be locals regional J national or even international. Different parks 
of the R/D&I system may have different socio/cultural environm©nts,V 
dape^kng on the geographic location^ the R/DM function involved^ 
^etc.j diffarent sectors or different types of innovations may be im'- 
pae ted differentially by the socio/cultural environment; organizations 
or systems serving in a Wde national or international afea may en- 
counter several differing socio-cultural environmentSj etc, Some Im- 
portant issues couid Include: 



What social/culturar norms and values influence knowledge production 
and knowledge utilization in general and for ^he R/D&I sectors 
systemj function^ or innovation in particular? In what ways 



and with what effects? 
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How is R/DM perceived by the reliant society or culture in terms 
of status and legitimacy? Is^he society or culture open and 
responsive to innovation and change? If not j what are the 
barriers which are relevant to the R/D&I system? . ^ ^ 

What alternative career oppdrtunities (within and outside of the sector) are 
avairable to R/D6tl system personnel? rWhat relative status do the alter- 
native careers have? What is the genaral status of careers in R/DS] 

C. Economic Environment 

Befcause an R/D5iI , system Is highly dependent upon the level and st^ability of 
Its fundings we nee4 to understand the overall economic environment which 

affects such fundings Here aome important issues could be* * 

— . - ■ - .. ^ 1 • " " " " " 

V^at is the- state of the host economy (of a country) in general and for the 
sector aerved by the R/D&I system in particular? 




^The funding , process itself is discussed as a separate .feature later. 
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What la the ^avalopmant pattern of the host economy (i, a* • rich or ■ 
poor natloni industrttfl/non-industrial; mixed or narrow based 
econMy; lesser dava loped country or da va loped country)? > ^ 

What is the level of priority given to R/DSel in the general aconomy 

and within the particularjsector served by the R/D&I system? Do 
the levels of priority vary among the K/D&I functions? 

What is the over a 11^ level of eKpendituras in. the sector served by 
the K/mi system? ^ ^ 

To what extant is the R/D&I system vulnerab la to short term and/or 
long term fluctuations in the general or sectoral economy? 

^ . What preparat ions or rasponses dqes the R/D&I- systam make In 
relation to eeonbmii f lustuationa?^ 

'Considerations such as th^ above hot only prpvtde insights into how 
and why an R/DW system operatas as it does, but also suggest 
policies and ^strategies relevant to system development and ^ 
orchestration. ^ 




D *_ ^KflQw 1 e d ge /T e c h no logical E n vif onma nt ^ ^ 

It is^ dbvious that (by dafinition) an R/D&I system and it^Hlnst Itutions 
are affected by tha knowledge/ technology which is available* Further 
it is also important to recognise that R/p&I systems interact with 
and utilize/adapt the knowledge/technology of other R/D^I systems* 
(It Is for this reason that we include the knowledge/technology base 
as part of ,^e R/D&I system's anvironment « ) We should note that 
while the issue questions listed below are usually phrased in terms 
of the R/'D&l systeraj the questions also apply to the .institutions 
within the R/D&I system, - ^ ^ . 

' 58.' ^ . 
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&ome Ijttportant ^.ssues could bei 

what is the level of aophlstication (state of ^velopment) of the 
knowledge/technology baae? 

What kinds of knowledge/technology are dt are not available? ^ 

What factors and processes affect the develDpment , acquisition and 

' ■ ■ ^ " ■ - '. . ^ , ■ 

use of the knowledge/ techno logy base? 

What are the^basic disciplines and/or sectors from which the R/^&^l 

system draws its knowledgp/technplbgy? What are the mechanisms ^ 
, batrlerSs etc. for transfer of knowledge/ technology between 

1^ disciplines 5 R/D&I sectors , R/D&I systems ^ R/b&I institutiDns? 

r _ . , ^ . . . \ ' ^ . . - 

What technologies are generalizable (transferable) across sectors 
V and which are not? Why not? Across which sectors? 

What is the state of development of the R/Dfiel sys%em? How does this 
affect the R/D&I system- s capability to identifyj select and 
use potentially relevant knowledge/technology from other 

R/D&I syatems? 

*f -.~ 

What are the comparative states of development of the knowledge/ 
technology base among the different R/DM .funetlohs? What 
affect does this have^ on the overall knowledge production/ 
knowledge utilization flow erf Innovation (e.g.^ if the knowledge/ 
technology of development la significantly more sophisticated 
than the knowledge/technology base r^leyant to implementation/ 
utilization)? 

*^ ' ■ • # ' ' 

How feasible is technological forecasting? To what extent is it 
done (and how) by the R/D&I system, and its institutions? 

. . • 59' ■ 
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III . HISTORICAL DE\^LOPMINT , ,. 

Historical development li an importatit ^cdnteKtual feature from two 
perapectlvas. First, It will be important to know the level of 
deveLopmanft (maturation) "which currently characterlEag thi R/D&l^ 
system. The current level of development will have significant, 
implications for the types of.policier, programs and strategies ^ 
that are relevant, i ■ ' ■ 

- " ■> ' " ' ■ ■■ ' ' . f ■ 

Second, the past is a significant part of (and thus to a greater or 
lesser extent^ has a determining, effect ^gn) the/present and the ' 
future - - for syatems and institutions as well as for individuals. 
Thus,, to understand *'where" :it appears to be going, can go, ^r should 
gdj we must have adequate knowledge of its history. 

It Is necessary to consider the history o£ the R/dm system and 
also to have some understanding of the historical development of 
the institutions within the system and of the s^ectoral and societal 
contexts of which the R/D&I systeih is ^ a part. 

A; Development Phases * < 



Two points must be made here . In the first place, we are here looking 
at a complex dynamic of historical development from a general, ^ 
descriptive perspective - - not from either a normative or an 
"inevitability'* perspective. Thus, /we do not Imply either that all 
R/D6(I systems will inevitably reach each stage or find appropriate 
foAns of deveXopment; or that' all potential characteristics of a 
phase will exist for every system; or that historical development 
is a one-way process. Indeed, if a "mature" system becomes static 
and out of touch with its environment, it may aver time "declinq" 
(and no longer possess the characteristics .of a "mature" system) 
and/or repeat earlier phases of development. . ■ ^ 
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Seeondly^ the titeanlng of system maturation, must be understood sonfewhat 
differetytly in different aectors and in different cdntexts , ^ Thus , 
when compared (for example) with aerospace^ even a '-mature" R/D&i-.^^^^ 
system in a social service sector such as education will always be 
spmewhat more "messy" in its knowledge base^ system linkages , etc., 
s^ply because human/social systems have inherently hlghlyvalue 
laden contexts, have relatively hard-tordef ine goals and hard-to 
measure outcomes, etc. And on the other hand, industrial R/DScI 
systems may be more closely linked than social service R/D&I 
systems-. ^ * \ . . 
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Thus, while tile consnents and issue questions which follow are of 
potentially critical importance^ we must keep in mind that not 
all j./D&I systems are or need to be the same - - and that specific 
stage-of -development issues may apply differ:ently to different 
R/PW systems* With thefab^ve in mind, let us* make the following 
Qbservation^ , C?^^ " ^ . 

Institutions and systems do go through phases of development* The 
most simplified deacrlption o£ what is a quite complex dynamic would! 
be to say that systems have introductory ^ transitional, and' mature 
phases of development. The inoxoductory phase is typically charac- 
terized by inadequate system linkage, coordination, and overall 
management and direction; sigpCficant "gaps" in the system; un- 
developed knowing© /techno logy and institutional bases* The attention 

given to the various R/D&I functions is uneven and unbalanced, 

\ , ^ - ^ ' 

Emphasis tends to be placed on "localized" rather than on "system" 

issues and concerns . In »the transitional phase, many of the above. 

conditions remain - - but there are more established institutions; 

some linkages do exist; there is an at least identifiable knowledge/' 

technology base; In. the/ transit ional phase, however, members 

of the system^ have begun to recognize the above conditions as "system" 

rather than merely "localized" issues and concerns = - but the system 
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Is not yet ekpable of jaor# than minimal self-orchestratibn. In the ' 
mature stage of development, we find (where needed and appropriate) 
significantly developed and coherent knowledge/technology/ institutional/ 
personnel bases; linkages'do exist; there is a balance in the level 
of development of R/D&I functions; system management structures and 
processes are' operational ; ^ the system is more capable of a significant 
amount of • self-^orchestration; etc, ' 

Some important issues about the development phase of the R/d&I system 
could be ! . ' i 



What is the level of development of the R/D&I system, the R/D&I 
functions 5 the R/D&I institutions? 

Is the development level of an R/D&I system different from the 
^ development level »of Its sector? \ ' 

Are the. development .levels \of the R/D&I functions within a particula 
R/P&l system different from the development levels of the 
R/D&I functions in, other R/D&l systems^ with which It does 
(or could) Interact? 

# ■' ■ 

Are the R/D&I functions within an R/D&I system at different levels 
of deveiopmen^f i 

How do differences in levels of development impact "the interaction 

between the R/D&I system, and its sector ^ between R/D&I systems, 
between R/D&l functions within a single system? How do these 
differences affect the flow of innovation, the possibility of 
technology transfer, etc.? 
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To what "extent is system-buildini a critical need of the R/D&I system? 
For what parts of the R/D&I ays tern? , , 

^How well has a balance been maintained among the system* a R/D&I 
funGtions in terms of proper sequenGing within the overall 
ayatem development procesa and in terms of liost effective 
utiltgatidp of resources? Is there currently a need for 
\ staging /phasing policies and strategies in order to insure 
$uch a bf lance ? . 

To vrtiat extent has some aystem-wide agency played a role in ■ . 

- orchestrating the system^ to fill ^'gapa*^ to balance the rate / 

of development among R/D&I functions? Is there currently such 

a need?\ . ^ " » 

■ \ • ' ■ 

-. \ ^ ^ • 

Are system mechanisms established in the early stages of a system's . 

development re levant, to the current stage of the system's 

development? If not, what fleKibility does the system have to 

modif^ (or even eliminate) these mechanisms? . 

What are the time/maturation ef facts on: system operation effectiveness; 
delineation of issues establishment" of priorities; . 
institutionalization of the R/D&I system; acceptance of the 
RAD&I system and its outputs within the ^sector; etc. 

B. Critical Events in the Development of the R/p&I System 

Thus far, we hM ' ' ooked at hist6rical development from a general 
broad-brush persi>oct ive , It is equally important to know about and 
understand the impact of the more specific historical events which 
have been critical in influencing the development of the specific 
nature or character of an R/D&I system. Such critical events may 
have impacted the R/D&I system in a variety of ways - - e*g,: 
influencing the major emphases or foci of the system; ' increasin'g or 
decreasing internal system capabilities; establ ishing patterns , 



63 



ERIC 



precedents^ prlorltieaj requlramarits; supporting or blocU'lng system 

activities pr system davalopment; influanGing the relative rates 

of davalopment of the system's R/D&I functions (and thus the "balance" 

^ong these funct"iona| etcO* . . 

• ' \ ... 

An examination of critical events should include at least the^ following areas: 
1, Institutions Establlahed (or Pises tabllshad) ' 



When? Privateer public? Profit or not-for-profit? Academic or non-' 
academic? For which R/D6rl system functions? How has the balance 
among the various types of institutions been affected? 

2, Legal , ' 




What laws have significantly affected the development gf the R/DSI system? 
In what ways? Why were these laws passed? At what level of govern- 
ment (federal J states local)? In what ways have such laws changed - 
over times and with what effect? 

Political 



WxslZ specific evemts have significantly affected the R/D5fl aystem over 
time? Ill what ways? What significant changes have there been in 
the political context? To the eKtent the political cpntext has 
changed over tlmei what effect has the pattern of change had on the 
R/D61 system? ' ^ 

■ * *' 

4, Development in the 8tate-of =the-Arts 

What has been the pattern of significant developments in the atate-of-the- 
arts? Have the developments been relatively sudden or gradual? 
tojor single developments or Incremental developments? What effects 



have these developments had? 
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5»__ Fimdlng 

What has basn the level of funding for the R/DSI systA? Stability 
What have been the major sourcas of fuuding? What have the slg^ 
nif leant events in, funding? ^at Impact have these hmd on H/Dax? 

Grltleal events In all of these areas may be seen as an "input" to the R/DSi \ 
system which have had some significant (though of course .not expluslve) effect 
on dete^ining the idiosyncratic nature and characteristics of the R/D&I system 
both as it currently exists and as, it may exist in the future* We , may also 
ask: Have the critical events been ''-'appropriate" to the state of the R/D6el 
system's development and if not^ what has been the effect on the system? 

Ill* ^ INSTITUTIONAL MSE (NETWO^ OF INSTITUTIONS ) 

An R/D&I system is cQmposed of a variety of institutions wh^ch, 
loosely or coherantlyj form a natwork of institutions, ThuSj we 

will want to examine the -institutional base from! two perspaetlves . First j . " 

we want to look at the institutions themselves: what the constituent 
institutions are; what are their institutional roles within the r/D&I 
system; what their characteristics are, . 

Secondj we will- want to know how these institutions form a "aystefn--; 

what is the system configuration of R/D&l functions; how the . v 

institutions are linked together; what the charactertstics of the 

system structure are, ' = 



Constituent Institutions 



An R/D&I system involves a variety of dnstltutions which form- the. ^ 
institutional base of the system. It will be important to identify 
these institutions* Here, soma important issues could bei 

What institutions are Involved in the R/D&I system? 
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Are they s publtc/private; prof it/not-for-profit; federal/state/ ^ . 
local govarniQBnt; univetsltles/lriduitrrei/prof 
associations; etc, - \ ^ 

B« Institutional Roles Within. the R/D&I System ' . 

We will want to know what roles the various Institutions have within 
the R/D6cI system* Spme important issues could be* 

* ' ' '' ': ' . 

To what extant do ^he Institutions specializi in particular R/D&I 
functions (e.g. i rasearchj disaamtnationp ate?) Which 
institutions? Which R/D&I functions (or combinations of R/^^l 
functions?) ^ - , 

What are the roles of the various l^nstitutloha in*^ relation to the 
R/DM system as a whole j to other institutions of the R/D&I 
system, to other relevant institutions and systems in: the 
envlronmeht ojE the R/D&I system (e,g#i what is the role of/a 
government agency which is part of the overall R/D&I system?) 

" ■ ' V' ■ 

Do the institutions serve only (or primarily) the specific sectoj 

(e.g. I public schools s NIEj or the federally sponsored R&D labs 
in the edacation sector)? Or are they sector-spanning 
Institutions which serve several sectors (e*g,: NSF, IBMj many 
R&D organizations^ book publishers)? What is the level of 
their commitment to the sector , and why? 

C. Characteristics of Inst It ut Ions * " 



We will also want to examine the characteristics of the institutions 
of the R/D&I system* Some important issues could be: 

^What are the internal structures of the institutions (in terms of 

their conf Igurationj integration, centralization, f ormalizations 
articulation /visibility 5 stability ^ etcl) 
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, What are ,thelr in^rnai processai o decision makln^j communication, , 



4: - 



^ authority/status jj.cooperation'j etc* 
^What are tfhalr sizes, 'status, reaources, eKperience? 
What are their levels of maturation and technological sophlsttcatlon? 
What are their ranges of products ^ servides , etc? 

System Configuration fClusteri n ^) of *R/D&I Functions 



As we noted in Chapter Ona^ the varioW R/D&l functions may be ^ 
. g^rouped or clustered together in a variety of ways - - and they 
may be grouped or clustered together in differing structural' 
conjEigurations in or across different institutions within the same 
R/D€el factor or across^' differing R/D&I sectors. Some Important 

issues could be: . 

^- , :^ ^ ^-^^ ■ ^ ..■ <. . . 

In what form are. the R/D&I functions clustered- together (a^g.i 
/ linearity^ parallelismj looping/contiguous 5 continuity /gaps , 

^ redundancy)? 

Which r/D&I functions are clustered, togather? 

What' differences in .the above are there across institutions within 
^ t.he R/D6el system? \ ' ' . ^ 

; E. Int_er-Institut Ion Lltikagas . ' " 

The VI ^nkaga's -between the Various institutions of a /system and the 
linkages' of the system to its environment are critical. Thus 5 
some important issues could be: . 



1, Linkage Character is tics 



Are the linkages: strong or weak/ parmanent or short term? stable 
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or utia table? direct 'or pia Intermadiafy institutions/ ' 



maah an i mmsj a s e o c iWt i on s ? l- 



Are the linkages formal or through informal conBrnunication a 



nd 



Gdllaboration? ' -.w^ 



Are the linkages centralized oti diffuse? 

_ ■ - . ^^ . ' . . 

What; are ' the system' 8 procasses^vf or decision making and 
coiiBaunlcatlon? > 



What is the nature of authority arid status ifts^H^ linkage process? 



2L Linkage Structurfs and Mechanisms ^ * 

VThat are the aKlsttng linkage structures and mechanisms? 
How do they, wor.k? ' ' ' 



^1 



Who controls them? 

Are there "gaps?" 

3 Boundary Conditions 



Here;^ questions would apply both to the "boundaries" of Institution 
^tthin the system and to the "boundaries" betwaen the system and it 
anvlrbnment* - 

Is theVR/D&I system an open system (so that Institutions relate 
e'^sllyp collaborate, etc.) or a closed system (so that - 
l^ues of "turf" and "autonomy frequently and strongly arise)? 

Are these "boundary ^conditions" fiKed (efg,: ^ by law; by a strong, 
emotipn- laden history) or variable? ' 
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_4»^ Linkage Cqh sequence a. 



Are the eKipting linkages functional or dysfunctional 



1 or I\ 



? 



Do they seem ^^t^result in coord^ations cooper^^on^ confllet, 
or smply laoR of' system doordination^? 



Are there (or have there been) "Joint venture" arrangement's?" 
Between what ins t,itut ions? With ^at results (and Why)? 

F> CharacteristiGS of R/D&I System Structure 

We- will want to examine various characteristics of the R/D&I 
system's structure. Some important issues could be: 

What is the stability of these configurations otrer time? If unstable, 
why? Have the configurations changed in response to the 
developmental phases of the R/D&I system, of the R/D&I 
functlqn(s) involved, or of the particular institutions 
involved? 

Are the configurations appropri ite in terms of phases of development , 
institutional goals J the per sonne 1 / f inane ial resources of the 
ins t itut ions j etc? 

Are these configurations "vinible" (kno\^i) to relevant partiGs within 
and /or outside the system? 

Is there a balance among tiie R/O&I functions being performGd by the 
system's Institutions? Arc thura gaps? Is thGrc unnQCGssary 
redundancy? (Note: redundancy is nots -'bad*' per so*) * 

Is the structural conf Igiirat i on of: R/n6fi functions cGiitralized or 
ducentralizad and di CiuHtttr w Ithin the \i/Dhl ijystem? fs it: 
,formaiizgd or thirouHh i iil urmal an Acjc i at ion^i and linkagGs? 
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IV- GQAI^, POLICIES, STRATEGIES 

Goals, policies and strategies are tha "action-oriented" dsgects of 
R/D&I and are identified as a separate R/D&I feature for precisely 
this reason* While the terms may be defined various ly, we here 
mean to be comprehensive in our understandings by thin'king of "goals" 
as statements of what one intends or desires to happen^ of 
"policies" as the general guidelines for the accomplishment of goals, 
and of "strategies" as the speci-fic methods for accomplishment of 
goals within the guidelines of policies. In a detailed conceptual 
anaiysiSi we would be exainining goals , policies' and strategies at the 
R/D&I sector, system and institution levels. Further, such goalSs 
policies and strategies would need to be examined from at least three 
InteraGtive perspectives. 

A* Source 



There may be a variety of sources for goals, policies and strategies 
which can affect an R/D&l system and its constituent institutions. 
Thus, some important issues could be: 

What are the sources of goals ^ policies and strategies which impact the 
R/D&I system and its institutions? 

Are these sources external to the R/D&I sector, internal to. the 
sector, internal to the R/D&l systemj and/or , specif ic .to an 
R/D&I function? 

. % 

What is the organizational or^system level of th^ sources (e.g,i level 
of governnieLit ; level within an organization) ? 

What kinds of institutions are involved (e.g.: public/private; 
university; prof it /not - for-profit ; etc)? 
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What significance can/ should ba attached to the specific source of a 
goal, policy or strategy (e.g.* etatuSj legittmacy, sources)? 

Content r . 

The content of goalSj policies and strategias is of obvious significance. 
Further, the content of ioals, policies, strategies is dynmic in the 
sense, that it may vary and change over tirfe, in different contexts, as 

the knowledge base changes, as sectoral needs change, as R/D&I 

I- 

institutions change ^ etc. Thus, some important Issues could hei 

What is the content of goals, policies, strategies? How do they 
differ across the R/D&I functions? ' ^ 

Are the goals, policies, strategies related , to identified needs? 
Identified by whom? 

How are the goals, polipies, strategies affected by the differing 
needs, interests and capabilities of differant sourcas? 

What is the intended impact of goals, policies, strategies? What 



is the "secondary" or "indirect'' impact? 



Are the variouiT gbals , policies and strategies compatible or ^ 

incompatible in terms of the R/D&I system as a whole and/or in 
terms of specific R/D&I functions or organizations? 

What is the relative importance to Che R/D&I system and its 

institutions of the various goals, policies, stratcglus? 



How do changes in the context: (e,^g, : enierguncu or doc line of' 

institu42ions; changes in the knuwledge/tochnaiogy base; etc.) 
at.Cect goalH, poiLcIos, ntrategius ( i ii terms of relevance, 
feas ibi JLity 5 ehangi^M In tiiu guais/poiicii-i/strategies 
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Given that we know the source and content of relevant goals ^ policies 
and BtrategiaSs there are still a number of aspects df these that will 
significaLntly, influence the impact they will have on the R/D&I system. 
For jexamplej ^ . - 

Scope - - What are the funding requirements and conmiitments ? What 

R/D&I functions are involved? What institutions , other sectors, 
-other R/D6el systems are involved directly or indirectly? What 
are the person^^^khowledge/ techno logy requirements? 

Time frame - - Is the time frame long or short; realistic or 
unrealistic? 

Feasibility ^ ^ Can goals be attained or policies and strategies 
implemented? What changes would be required? 

FleKibiliCy - - Can required changes be made in the R/D&I system? At 
what cost? With what effects? Under what conditions? By whom? 
Js the required knowledge/technology available 5 or can it be 
deveioped? 

Clarity Are the goals, policies, strategies specific and clear, 
or vague? Are they clear for different relevant audiences? 
Do different relevant audiences understand them differently? 

/ . ■ 

Stability/continuity - - Are goals, policies, strategies relatively . 

stable over time 5 or do they change and shift? Over what periods 
of time? In relation to which sources? With what effects? 

Differential pet^ceptions - - Do various relevant audiences have 
similar or dissimilar perceptions as to tho Impoi^tance, 
relevance 5 feasibility, time fraines, etc. of the goals, 
impolicies, str/^tegies? ^ 
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Baiance - - Are goals, policies and strategies 'balanced in terms of: 
relative priorities; sources; the various R/D&I functions arid 
institutions^ system and institutional needs related to level 
of maturation; etc? 



romises - - To what extent are the -various sources willing to 
make compromises in order to achieve system balances , to 
orchestrate the system's activities ^ to fill gaps in the system^ 
etc*? What mechanisms and processes are used to reach such 
compromises? 



Appropriateness/congruence - - Are the goals j policies, strategiea 
appropriate and congruent in relation to: the nature of the 
function involved; the state of development of the systemi 
the knowledge/ technology base; adequacy of personnel/ 
institutional/financial resources required and available; the 
social/Qultural environment; laws and regulations; 6tc, 

V, * ADMINISTRATIVE PROCESSES 



Administration (management) is a function of all organizations and 
systems, and much of the research, literature and experience relative 
to this function is not unique to R/D&I systems* Nevertheless j we 
must be aware that the relatively high degree of uncertainty and 
creativity ^involved in the process of innovation will Impact 
administrative processes in R/D&I systems. We willj o*f course ^ want 
to focus our analysis on the R/D&I system in terms of describing the 
ekisting R/D&I system, in terms of identifying those aspects or 
characteristics of the administrative processes function which are 
specific to R/D^^I systems 5 and .in terms of determining what 
admin i s t r a t i vc tec hn o I og i n s c a n or can no t b a t r a n s f e r r e d f r om one 
sector to another * 
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We should also note here that we Include both policy and operati*onal 
levels of administration/management within our understanding of the 
administrative processes function, 

I 

The literature on administration is quite copious ^ both in terms of 
sheer volume and in terms of identifying and analyzing a large 
number of aspects ^ character tst ics and processes of administration* 
''Thus, analyses will generally need to be selective - - but not meager. 

/ 

A_*_ Responsibilities and Ta^^s 

There are many responsibilities and tasks which may be part of the 
administration function* These may be (and are) identifiedj 
described ^d labeled variously^ but would at least include the 
following broad categories: 

- identification of goals and objectives 

- establishment of policy 

- formulation of strategies 

- planning and progratraning 
- - mobilization and allocation of resources 

- design^ installationj operation and modification of 
management systems 

- conmiunica t ion 

* 

- motivation 
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For each of these areas of administrative responsibiLitie^ a^^'^baskSj' 
some important issues couLd be : , , , 



Who has the responsibility? 

Who actually performs what aspects o%^the required tasks? 




What skills are needed? 



How and by whom are responsibilities and tasks assigned? 

At what level within the organization or in what part of the system 
^^^^asponslbi lit ies and tasks located? 

Upon what data are decisions made and actions taken? What^ are the 

sources of this dat^? What degree of reliability and certainty 
can be ascribed to this data? 



B* Administrative Relationships 



... / 



Administrative relationships involve the organiEatlonal ly based intei 
actions between the personnel of an organization or system* While 
administrative relationships are defined in relation to organizational 
^roleSj tasks s rules, etc. (and are usually understood to be "formal^ed") 
administrative relationships may vary In terms of clarity and preciseness, 
commonness of understanding between the parties involved ^ degree of 
forma Itzciti on s etc. Further^ attention must be given to the interpeesonal/ 
intprgr^^p re lat ionships , between the parties involved tn an administrative 
relationship. We do not incLude here inter organizat iona 1 relationships per 
se (though there may be some overlap), as this is part of the institutional 
base feature . - , 

S ome im p o v t a ri t i s s u a s c o u I d I) u : - ■ 

yJ^a t is tlie lu ve 1 o 1 a d in 1 n i s L rn t i ve r o I a v 1 o n s li p u n d u r c o n e i d e r a ^ 

tion, (i.e,, at i iiLeriia t ioua 1 j uatioual, Hyateiiij institutional. 



intra-institutionaL level)? 
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What type off organization or organizatiohal unit is involved, (e.g.: 
federal agency, a private businese, an academic institution, a 
regional lab^ a connnittee, a task force, etc,)? 

What is the mode of the administrative relationship (e*g*: line- 
staffi'^- liasona matrix , etc,)? 

What is the formar nat^*e of the relationship ^ (e.g. 5 legal, 
authority^ voluntary^ consultative ^ advisory , etc*)? 

What are the interpersonal (intergroup eharacteristics of the relation- 
ship, (e.gp^ colLaborat long ' competitive , conflict charismatic, 
trust ing/suspicious 5 etc.)? 

C* Administrative System. Characteristics 

We may examine the administration function in terms of its characteristics 
as a system itself. Some important issue areas could be: 

To what extent is the administrative system centralizedV^Dr decentralized? 
Is this appropriate or inappropriate in terms of the level mf 
system maturation, the nature of the tasks involveda the nalture and 
needs of specific R/D&I functions, etc.? 



To what extent is the admintatrative system formalized by rules 3 
regulations, policies, procedure manual&\ etc.? 



Is th^ administrative system relatively adaptibke or inflexible? What 
parts of the administrative system? Under wH^t c conditions wmjdd 
adapt ibilit^^,,.^ qriost needed? What costs would be involved in change 
ing the ^administrative system (financial costs, system disruption , 
loss of personnel J iCtc*)? 
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In what ways and to' what extent Is the administrative system 
organiE^ad by/depandent upon spacializations (in terms oft 
types of specialization needed within the administrative 
system; impact upon the structure of the s^^^^* specialized 
managerial skills required)? What types of specializations? 
In what ways are such spacializat ions integrated with or dis^ 



aggregated from each other? What level of technical sophist!^ 
cation is required with regard to the different spe'cializatlons? 

In what ways and to what aKtent is the administrative system based 
upon/affected by formal rules, procedures, etc.? 

To what extent are administrative rolag, relations ^ policies , selectj- 
ion of personnel^ etc* politicizaG (i*e,] affected by political 
dyanics)? What are the sources/of political dynamics (a*g*: 
internal to the system; pressure groups; governmental)? How 
pervasive are the political dynamics within the system? In refer- 
ence to what issues? 

D* Character istics of Adrrtinstrator s 



The individuals who are the administrators bring certain personal 
characteristics to the process of administration. Among those 
characteristics which might be of particular significartSe to R/D&I 
could be the following: entrepeneur ship ^ risk propensity , innovative- 
nesSj receptivity to change.-. Some important issues here could be: 

To what extent do the administrators of the R/D6I system reflect 
these characterffi^ics ? In wUich organizations? 

Does the impact of and /or nuud iur these characteristics difter accord- 
i ng to R / I f LI n c t i o n s 5 d i f C a r q n t o r ji^ a n i z a t i 01 1 a within the system^ 
diffpreut levels wlLhin organiz/it 1 oiib , difiurent levels of systetn 
maturation, typo of innovation, utc,? . 
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What Is the Impact of and/or need for other personal characteristics 
of R/D&I system administrators (e,g.: leadership style; 
orchestration^ collaboration, political skills)? Under what 
conditions? In relation to what parts of the system? 




E.. Administrative Techniques 



Various administrative techniques and methods are used tfb perform the 
administrative processes function. These may differ between sectors ^ 
between organizations, according to tasks involved ^ etc. aome ImpoVtant 
issues could be- 



What administrative techniques are connnonly used in the 
How do these compare with or differ from those used 
systems and sectors? 




system? 
other R/D&I 



What administrative techniques are most relevant In terms of the level 
of R/D&I system* s maturation^ the different R/D&I fiunctlons, th^ 
nature of the tasks involved ^ etc,? 



What are the cdnditions which hfelp or hinder the' applicability/usability 
of administrative techniques across different sectors? Is a particu- 
lar technique whi^h Is useful in one sector also useful in another 
sector? If not j why not? 



what are the patterns, mechanisms, dimensions of transfer and diffusion 
of administrative techniques from one R/D&I system to another? 
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VI. PERSONNEL BASE 

It is obvious thatf the personnel ' base is a critical aspect of any organize 
tlon or system* This is especially true in any R/D&I system which , by 
definition^ involves the human activity of creativity. It is also claar 
that the personnel *base feature is a highly Gomplex feature one which 
can and must be analyzed from a variety of interative perspactivas. We 
will hare suggest and illustrate soma of these perspectives* 



In broad terms ^ wa may sea the personnel base both as a i^iaource input 
to the R/D&I ays tarn and as an output of the system. Thus, from the 
resource input -perspective 5 we will' want to know how the personnal base 
impact^ the system in terms of: the skills 5 perspectives ^ aKp^rienca^ 
etc, which they bring to the system; whether or not personnel needed 
by the system are available or not; the eKtant to which individupl goals 
and objectives are similar or dissimilar^ compatible or incompatible 
with goals and objactivas of an R/D&I system or organization; ate* 



On the oth^ ftand , the parsonnel of an R/Dfitl systam may be seen as an 
output of the system in the sense that the parsonnel do change as a 
result of training nhey receive; their socialization into tha systam 
and its organizations; the learning which occurs through experience; 
etc. 

* e 

A. Types of R/P&I Personnel: Needs3_ Availability and Sourcas; 

One of the first things we would want tt5 know about an R/D&I system's 
personnel base is the _types of parscmnel (and personnel "expertise") 
which are^ needed by the system. Some important issues could be: 



What types of personnel are currently xieeded (u,g,: adniinistrativu/ 
technical; ac lent i g Ls/eni-U nuor yi/nmchino 0])uraturs ; skilled/ 
semi^ sk i 1 1 ud / u ns Ic i L I u d ■ u L c: , ) '! 
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what typee of personnel are needed In terms of the specific nature/ 
needs /requlreinents of: the diffe.^ent R/D&I functions; the 
particular sector; the type of technology Involved; .the particu- 
lar .organisation (or type of omaniEatlon -^^ e*g.: govermnent 
agency^ private Industry, uni^rslty, R&D organlEatlon, user 
organization J etc); gove^-THnfental requirements (e,g,* age, sex, 
race antidiscrimination aaws) ; etc? 

What specializations are n^^^ed? What tnix, mass and balance ^f skills 
and specializations are needed? G< 

What time lines are involved either for training persDnnel or for creat- 
ing sources of personnel (e*gp: how long does it take to train a 
researcher, a disseminator , a technical speGiallstj etc*; how long 
does It take to create programs and institutions to provide such - 
training)? ^ 

What has been the historical pahtern of the system's personnel needs? 
What are the projections for future i^eeds? 

In what ways are current and future needs likely to be effected by such 
factors as: technological changes; changes in the economy; fund- 
ing patterns; needs of the sector; marketplace demands and require- 
ments; turnover ratei^ i(and what are the causes for the turnover 
rate); changing ages of current personnel over time; retirement 
rates; existing or anticipated laws; obsolenscence ; aging, etc. 

We would also want to know about the ava 1 1 abji^j ty - and sources of needed 
R/D&I system personnel. Some Important issues could be; 

Are the needed personnel available, in short supply , or in over supply? 

What has beeu tlio historical pattern of tlia availnbllity of needed / 
personnel? ^ 

What are 5?ig projections for future avnilabillty of needed personnel?. 
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' . ' : , 

what is the impact' (short term and long term) on the system of. the level 
of availability of needed,, parsonnel? - 

In what ways, will availability of needed personnel be impacted by such 
factors as* the ability of the R/D&I system to attract and retain 
needed personnel; funding patterns; technological changes; retire- 

/ 

■^^ mant rates; ^overmnent^' ^regulations? 

What are the existing sources for needed personnel (e,g.: universities 
and colleges; technical institutions; internal , organizational 
training programs; second career persomiel; etc*)? Do these sources 
... exist within or are they external to the sector? Are they adequate 
in terms of either number^ quality or particular types of personnel 
needed? If not, can' the system provide such soiirces? / 

What environmental factors affect the personnel base (e*g.: population 

growth rates 5 laws and regulations ^ societal norms and values s state 
'of the economy, etc^)? 



B* Professions and Occupations 

In addition to looking at the personnel base from the general perspective 
of the r/D&I system^ we wjpll need to examine a^ separ_a_te sys temg those 
Specific professions and occupations which. are relevant to the R/D&I 
system. Some important Issues could be: 

To what extent are the various pi^ofessions and qccupatlons specific to the ^ 
sector in which the R/UtSI sytitem exist s (Cpg.- the teaching profession 
of theie^icntion sector)? To wii at, extent arc they sector spanning 
(e.g.: c omp u t e r t u c 1 1 n i c 1 a tis ) ? To wh ixt e x t e n t d n tli e y -^(^^^ both 
sector spanning and sector s{)ncific nha rac torin t Ics (cug.: resuarchers 
within a Hpeclfic dificipliius .^hoHu roMenirch Mkll I'l /iiiuthtnlol ciglus may 
be a least partially hoc tor spa unit ig hut who are socialised in /commit ted 
to a spec 1 fir sector)'; 
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i ^ ' ' 

Are there ^rganized associations related to the p«ticular OGcupations^ and 

professions? . What status and power do they have? Are their goals 

0nd values ctompat iDle or incompatible with the , goals and values of 

the R/pfil sector, system and/or organizations? What is the level 

^ of cpmmi^ment of th|se associations to a particular R/D&i sector or 

'system?^ . " ■ ' 4 

■- ■ ' ij 

What are th$ entrance requiremerits/standards/regulations for these 

professions and occupations? Who sets them? Who implements , and 
monitors them?! who evaluates potential ^personnel? What is the ^ 
lmpact|0% these requirements/stan on the 

avallaMllty of needed personnel? ^ 




What are the Ffnowledge llf e cycles /for these professions and occupations? 



What career paths are provided within the E/D&I system? Are the^e 
alternatlye career paths, within the system (.^^,: between 
^/^t"^^^^^""^? ^^^^^^^ R/D&I functions)? A^e there alternative 
career paths' available in other sectors or R/q&I systems? Wiat 
are the mobility patterns within the R/D&I system, between 
professions and occupations, between sectors? 

What are the status systems within the r7d&I system? 



C* _S yg t em Ac t iy 1 ties ^e 1 ar e d _t o the Pe rs o one 1 Base 

It will be impg^tan^ to kiiow how the R/D&I system responds to its personnel 

needs* Obviouslys here our Nconcerms wi J. t*' over lap a portion of the admin^ 
istrative processes function'. 

,Hore, some important issues could b o 

what is tlie nature, extf^nt and ndecjuacy of munitoring , ^ forocnR t in^> and 
planning iov t\\x\ HyHLtMll'^^ pc» rHounc?!. needw? ' ^ 
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What: is the nature of the system's incentive systems (e^g.i finanQialj 

position^ status s ptomptioni formal/inf orraal ; etc.)? Are they ^ 
, re levant to the needs and motivations of personnel? How do they 
differ across R/D&I functloni and intJfii tut ions ?4 ^ 

what are the processes and criteria for recruitment and,^ selectio^ ^of personnel? 

V ( 

^ 'What is the nature of the spclallzatior^ process for system personnel? 

What Is^ the typej extent knd methodologies of training and deve|ldpment? 

-Does the system deal v^ith personnel obsolescence through replaqement or 
training? 

Who sets,,5 ImplfeinentSs monitors R/D&I system requirements in relation to tasks 

' ■ ' ' ' ■ ^ ■ " / /■ ■ 

of the systemj per.formance requirements and standards , e^c*/? Is this ■ 



le Internally witfbin the system or is this imposed externally (e,g, 
by governmental laws, regulations/ agencies)? gow are ^hese 
"enforced'*? - 



[/disused .tliroi 
i^ron? Are there 



/ 

^^^Hbt^^i tnCotW^z t"o n^ab^SlH " t he^ "p eVs o rinel base" d i s s'emi na t e d / drftu s ed \t Krough ou t. 
the R/D<5tl system? By whom? usek sueh informatj 

significant "gapF*"? 

■ ■■■■/- ' / 

D, Gharacteristics of the System's Personnel / 

:^ _ _ - 

/ 



^ Thus far, we Ha^^^ f ocusad on the personnel base feature in terms of the R/D&I 
system*^ It will also be important to have some knowledge, about the personnel 

themselves. Here some of the major issues could ^e- 

- ■ / - ■ 



/ 

/ 

Q n ' / 
u u 



5" ' ' 
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'What are. their levels of coitmitwerit to the sector, the R/D&I system and . 
particular organizations? ^ 

What Is the nature of their motivation^ (e*g. : financial ,^^atus , res-r 
ponsibillty^ creativity, etc*)? Are these motivatlQ^ "tiatched" 
with the incentives provided by the system? 

What ^ are the values of system personnel? 

What are the goals and objectives of system personnel? Are these com- 
patible or in conflict with' goals and objeGtiyes of the R/D&l 
system^ functions and Institutions? ^1^ . • , * 

^ ■ ' ■ ■ I ■ .,■ 

What perspectives 5 experiences , biases ^ etc. do the.^^^rsonnel bring to th# 
R/D&i system (in terms of their background)? 

VII . FUNDING - ' ' . * 




Funding is a feature which, at least at m minimum level of sophistication ^ is . 
easily recognizable as being significant to the process of innovation. Indeed, 
in our analysis of other f eatures ^ we ha^ve^^ef erred repeatf dly j to issues of 
=jqaB.t •__Hm^var^=^hlrle^ analysis' of- f^ditig -mus=t--&bvteusiy--i^i 
of cost, analysis of funding must also Include consideration of sources of ''^ 
funding, availability/obtainabillty of funding, the^^oQess and constraints 
Involved in obtaining f,u'nding| the stability of fundings and^ so forth, InM 
word, "cost" focuses basically on amounts ; '"funding" focuses more broadly^to 
include processes and dynamics. , 



Sourcpa of Funding 



<9 



At the^ simplest' levels it will be Important to know where funds for R/D&I 
come from. Some important isBues could^be: ^ 

What are the major sources of R/D&I funding: governmeirfi sources (and from what 
level of government: locals state, federal, even governments of other 
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cbuntrles) J foundations; ^private organizations not involved In th3 R/D&I 
system or aeptori private orgahizat ions which are part of the R/D&I 
system or sector; investment organizations; etc*? - 

i ■ . .. V, ^ . • 

In what ways are the sources subject to such dynamics as the waxing and waning 
of national issues; political shifts; the general economic climate;^ 
degree of risk involved? Do such dynamics affect the various funding 
sources similarly or differentially? . 

^What is the level of cotranitment of *the funding source to R/D&I? To a particular 
area of concern? To a particuiar innovation? To a particul^tfr R/ 
sectotj system or institution? 



7 



What aspects of R/D&I are of major or peripheral concern to the funding source? 



What is the financial cqn^jgion of the funding source? How much of its funds 
are available for R/D6£l? ^ 



Is funding for progranis /pro j ec ts stimulated by field- iniated proposals or by 
funding agency p lans /programs /reques ts- for- proposals? 

What kinds of return on investment does the funding source expect (e,g,: 
financial J. new products, system building) ? Within what time frames? 

What are the policies of the -funding source with respect to R/D&I? With 
respect^ to a specific R/D&I sector , system or institution? 



Bp Type o^ Funding 



Funding from the various sources 'may be of several types. The issue here is 
not whether one type of funding is inherently "better" or "worse*'- Rather | 
it is important to recdgnize the implications for R/D&I that accompany dif-= 
ferent types of funding. Further^ it is important that the type of funding 
be appropriate to the need - - and the need' tends to differ across the 
various R/D&I functionsr For example ^ .when system building is the major R/D&I 
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systam need, a federal agency may need the flexibility to select a few high 
quality institutions (or to create institutions) rather than scattering Its 
funds among many Institutions and thereby abdicating any responsibility for 
'fquality control". In such a situation, grants would be a more appropriate 
type of funding than competitive bidding* ■ . 



Some important issues could be* 



What tjrpes of funding are available from the various funding sources (e*i,- 
appropriat Ions from legislative bodies to other government agencies; 
grants; contracts; sales of products and services; etc.)? 

Are funds available on a ''sole source" or only on a competitive bidding basis? 
Are funds provided on a flHed amount or a cost-plus basis? 

How do the types of funding diffm^ in terms of the amount of discretion and 
fl«Kibility the recipient may exercise ,in the use of funds? 

Is the type of f unding^^vailable appropriate to the needs of the R/D5il system, 
* funct;ion or institution? To the type of program or project being funded? 

On what basis is funding provided (e,g,: historical basis; percent of 
income/sales; etcO? 

Level and Adequacy of Funding 

.- . » 

The level ^Rd adequacy of funding is clearly Important for R/D&I. Some im-- 
portant issues could be* 

What, is the level of fundini with respect to the sector^ the ^|^D&I system, 

each of the R/D&l functions, specific areas of-R/D&I concern (e*g, • the 
aerospace/moon landing concei^ of the 60s; filling "gaps" in the dls-. 
semination system) ^ specific programs/projects, and as relevant ^ specific 
institutions? 
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Is the level of funding adequate to meet a particular R/D&I system need Qr 

the requirements of a particular Innovation? 

Is the level o^Jundlftg balanced across the R/DStI functions in terras ©f the 
respectlva levels of funding needs of the R/D&I functions and in tetms 
of the total flow of innovation from toowledge production to knowledge 
utilization?. / , 

Is the level of funding adequate to meet the expe^at ions' of the funders? " 
* (This quesb^on should also be phrased in terms of whether or not the 

expectations of funders are realisticO 

What can/should be done within the limitations of the eKistingj given level of 
j funding? - . ^ 

Are there maximum levels beyond which funding canndt be used effectively? (Fo: 
example 5 the amount of funding that can be effectively utilized within 
the basic research function will be limited by the extent of the existing 
personnel/Institutional bases*) 

Are there minimum levels of funding needed in terms of (for example) the costs" 
in a particular area of innovations the need to maintain (but not expand) 

What factors must be considered In order to determine the level of funding 
needed (e*g,i the capital, operating^ personnel and maintenance costs 
involyed during the various stages of the R/D&I process; the nature of 
/the innovation involved; whether or not system building is involved; 
etc.)? 

• - - i ' 

D. Stability of Funding 

In R/D&I, stability of funding can be critical p Some important issues could 
bei . ' 

Has funding tended to be stable or unstable? 




what has been or would be the short and long term impact of funding insta^ - 
bility in terms of: R/DSeI system stability and capability; the per- 
f^nnel and institutional bases of the R/D&I system; short and long 
^e^tn return on Inveitment; sunk costs; whether or not there will be 
Intiovatlon "outcomes" or "results''; t^e adequacy of innovation out- 
comes /resuits ; etCfc? , 

Over what period (length) of time is funding stability needed? 

. . 6 

Is there a range of funding levels within which funding may fluctuate 
without severe short or long term impact? What is this iratige? 

Do funders tend to "pull the R/D&I system up by its ropts" periodically? 
Does^^^^ls differ across .funding sources? ' 

Do these considerations vary across the R/D&I function^ ; across the 
Institutions of the system; In terms of the relative state of 
developmeiit (tnaturation) of the R/D&I system, functions j Institutions?- 
In what ways? 

i E. Other Considerations ' 

^^^^.^—^^Q^.^^p^Q^Q.^^^. i^#l^e:nee "wh-efrher- funding -^-w^^ -p=rc^l<ied^-£Q^*R/D&-I--and='h^w 

it can be used (e^g,: laws and regulations; the degree of risk ihvolved; 
the perceived importance' or urgency; differences about return on invest- 
ment criteria; etc,)? i 

What is the pattern of funding (ipe.: what R/D&I functions, what institutions, 
what innovations or areas of concern are funded)? 

To what extent hav^ funding patterns tended to "shape" the R/D&I system in 

* is 

terms of which Issues /concerns are emphasised or neglected; which ByD&I 
* functions are. developed or neglected; the focus, character and strength 
, of R/D&I Institutions; etc? ' - ' ' 
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VIi:^^ iNFQRMAtlON FLOW ^ 

In a manner similar to the funding feature , Information flow la a feature 
that "run$ through" all aspecta- of R/D&I^ Again, howfvei^, it ia of auch 
signif^ance that It wacrrants consideration as a separate feature. We will 
want to%nalyEe Information flow both within the R/D&I system and between 
the R/D6£l^ya tern and Its environment, as well as within and between the 
institutions of the R/d&I system. : 

There Is obviously a considerable' body of literature dealing with connnunl- 
cationj information flow,^ etc. Thus , we will here simply highlight the 
.types of issues that would be relevant f or . r^j^arch, analysis , policies s 
or a trategles , =^ ^ \ , 

Sources of^ information * 

There may be a variety of sources of informatiori for an R/D6gl systemj and 
these sources may ddffer in significant ways/ Some important issues could* 
be: . 

Who or what are the sources of information within and external to the R/fi6£l 
> system? To Ae institutions in the R/D&I system? 

Are these sources: individual persons and institutions (eig,: researchers 
or research prgaMiEations ; policy makers or policy making agencies; 
individual or. organizational users; etc.); organized information store- 
house| (e*g*: clearinghouses; libraries; data banks such as ERIC in the 
education sector; etc*); various typ^s of literature (e.g.: Journals; 
books; records and documants ; newsletters; etc); governmental (federal, 
state 5 local or private; related 'to a specific R/D&I funetion, or to a 
pai^ticular discipline, or to sorne institution within t^e R/D&I system; 



etc*)?' 

. I 

Are there several types of sources containing similar information Ce.g*^ a 
researcher whose article is printed in a journal, which is then stored 
in a data bank* and sunmarized in a newsle#&£r) ? 
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In what ways does' the nature of the sources affect the potential availabiiity 
' of needed Infomation? The potential validity and relevance of fihe 

Information? In what ways might the potential biases and limitations^ of 
perspectives of the sources affect trie' Information they provide? 

B. Recipients of Information 

We will also want to know who are and/or should be the recipients of what 
Information, Some important issues could be^ . ' 

Who should be receiving information? What information? 

Who does receive inf ormatioij? Do they need the Information? Why ate they 

recalving the information? . Are they appropriate recipients of the infor- 
mation? Is there some needed information they are not receiving? 



Who is not receiving needed information? Why not? 



C* Information Flow Channels 



In order for information to get from the sources to the recipients ^ there must 
be channels for information flow. Some important ^is^yes could be : 

What channels exis^? N 

Are the channels formal (e*g, : newsletters-; dissemination organizations; 

journals; papers presented at prof ess lon^ jftieetli^ * formalised inter- 
orgahizatlonal and intraorganizattonal channels and procedures for com- 
munication; etc*) or informal (at meetings; by t^l^phone as the occa- 
fan arises; invisible colleges; etc.)? 



Are the channels appropriate? (Do they connect the right sourtes with the 
right recipients)? i. ? 
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Arm the channels adequate? (Are there gaps? Can th^ chann^li "carry" enough 
information? Do the channels "distort" the information? If so, in what 
wa^? . Do the channels "screen" or synthfesize information?) . ' 

Are the channels used? (If not 5 why not? Are they designed so that recipients 
can assess them? Are they known to potential users?) ^ . 



D, Patterns of InformatlDn Flow ■ ^ 

We will need to ascertain .the patterns of information flow in order to determine " 
both the nature and adequacy of information flow. Some important issues could bei 

What are the primary patterns of information flow in terms of who conmunlcates 
with whom? la the information flow unidirectional? Two-way but between 
isolated sets of senders/receiifers? Multidirectional among a variety of 
sender^ and receivers? , - ^ ^ " 

What sources^ -of information and channels of information flow are or are no,t 

used? ' ^ , . . 

.l^a^t_^e^thod_qlo^ies and^tecjinig^ues ar used? To what extent does the 

information flow tend to-^^Jormal or N^n^ormal? __. 

How and by whom is the information flow prpcess initiated? (Do users contact 
producar^? Or do prqducers contactf users? Etc) Who seeks information 
and who does not? Why? 

E- Purposes of Information Flow ' , * 



Communication is a purposeful act. The purposes may vary, may be different 
between sender and recipient ^ may he eKplicit, implicit or "hidden"* Thus ^ 
some important issues could be: . , 
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wAat purposes do the various senders and reelplents have for eendd 

receiving information? How do the purposes of the aenders and receivers 
differ? What perceptions do senders pind receivers have about the purposes 
of each other? ■ ' 

Does the information flow adcomplisft the purposea of aenders and receivers? If 
not J why not? . ■ 

From what frames of references is information sent and receivjed? (For example ^ 
informa^tion about an identified need may be interpreted differently by a 
user and a researcher*) ^ 



\ 



F, Networks of Information Flow 



'The discussion thus far has implied but not specifically examined information 
flow from the perspective of networks of coranunication or information flow* 
Such networks may be formalized or may be informal, centralized or diffuse p 
separated from or integrated with each o.ther* Here the key Issues will be* 

Where^ to what*" extent and by whom are such ftetworks needed? L ' 



Jo what extent do suchmetworks exist? 

In what ways are' the networks connected with each oth^rl 



fthat networks are external but relevant to the 'ft/DK- systeii 



What impact does the eKistence or lack of such networks have on the R/D&I 
system? , ^ 

In what ways are the networks effective or inef&fctive? 



/ 



Who performs the various information processing roles within the networkE 
(e«g,: the role of "gatekeeper")? 
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G* Uttllzation of Information 

When InforTnation flow occurs, there are expectations that Information wiir be 
used and about how the inforinatipn will be used. Here some important isaueg 
cpi^fc be: ^ 

What expectations do senders and receivers have about how infermation will be, 
used? Are the expeetations similar or dissimilar? Compatible or Incom- 
patible? If disjilmilar, or incompatible , why? , What is the effect or 
impact of there being different understandings? 

How la the Information actually used? Or^ is it used? If not, why not? ^* 

H 6 C ont ro 1_ and Ac c e s s 

- ■ ^5 

J ' ^ ■ ■ . ' 

J • . ' ' 

It will be important to know who controT.s the information flow and how, why 
and with what effects* The issue of control is not simply one of authority 
or position, but also is a matter of the types of blockages that effectively, 
control (in the sense of limiting) information flow, It will also be impor'- 
tant to know how information is stored and accessed* 

*' 

Some important issues could be: 

Who determines what information will be sent or received; by whom and to 
whom; when; and wKat channels and methodologies can/will be used? 

Is, information flo^E? open, or is it limited by laws^ regulations, political 
cons iderations 4 costj suspicionj lack of awareness by senders of the 
need a recipierrt has ""(or, vice versa ^ lack of awareness by a recL^lent 
that information exists , or what Is the source for information, (or what 
channels to use)? ^ ^ 

liovf is information stored and accessed/retrieved? Is information storage/ 
retrieval automated? " = * . ' 
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Who determlnee: what Inforrnatlon wll4 be stored; how It will be stored? 
what the retrieval mechantsms/processes will Ke, who will have access 
-to inf orTnatlon? . ■ . 

IX, . INNOVATIONS '/ ~ ' ^ ■ 



All of the contextual features ha^^ discussed thus far have assumed the 
eKistence of some innovation(s) = - and some UTtderstanding of the inno= 
vatlon(s) involved ^ust indeed be incorporated in the discussion of any of 
the contextual features. However ^ this very cantrality of tha innovations, 
themselves warrants considering "itinovatlQns" ' a separate Seatiare to 
Insure that adequate attention is given durin^.any analysis* Depending 
on th'e type and purpose of the specific analysis, the focus may csfnge from 
consideration of a specific Innovation to the. broad range of innovations^^ ; . 
relevant to a particular R/D&I system or sector. 

It Is also . important that we not narrowly limit our concept of what is an 
Innovation* An innovation may be a new proc^ct, a new .process/me*fihociology/ 
te'chnique 3 a new concept/ theory^ new inf ormSTiori, etc. The Innovation may 
be related to any R/D&I function or set of R/D&I f unctions ; imay. involve a 
single Item or a set of items, ^ 
i 



The analysis of the innovations feature would include at least three general 
types of consider^ttons : requirements for the innovations;, characteristics 
of the innovft ions'*; impact and benefits of the innovations. Naturally,, 
these J overlap to somp eKtent, 

■ \ ' ■ ^- ■ ■ . ) 

' ( . / 

Requirements ^or. the InnQv;a_tj. ons 

It will be import ^t to know what requirements the Innovations must meet and 
what requirements / the innovation itself imposes on the various elements and 
functions of the r/D&I system. Some impo^e^nt iasues could bej ...-i^ . 
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Need Identification - - What needs would the Innovation meet? 'Whose 
needs? How were the needs identified? By whom? ^ ^ 

Level and scale of effort - - What scale of costs are Involved? 

What level of complexity and sophistication of technologies Is in- " 
volved? How iftany and what type of personnel and institutions are 
involved? What length of tirae is required? 

System r)aanagement - - What impact does, the innovation have on' the mapage'^ 
ment ^f the R/D6£i system in terms of coordination/orchestration/co™aunl= 
cation efforts; nature/amount/ type, of . involvemetit with organizatlpns 
external to the R/DSel system and sector? ^ 

State of the arts - - What state of the' arts of relevant technologies*' 
—=~ is requires by the innovation? What Is the current state of the arts, 
and i| it adequate or not? . ^ 

User requireTnents - - What do ussrs expect from the' Innovation? How 
must the Innovation be developed and produced In order for it to be 
^compatible with the user's system and capabilities? (Or, -alterna- ^ 
' tivelyj what changes would be required within the user systetfi?) ' 

ConitraTnts - - What governmental Taws and regulations impose require- 
merits on the development j productionj dlssemtnation , utilization of 
the Innovation? What requirements? At what level of government? 
What requirements are Imposad hy other organizations (e*g,: profes= 
sional associations; the participating R/D&I institutioris ) ? What 
SQCial/spcietal constraints exist and ^ow would they impact the . 
innovation at any ^stage of the knowledge prD^uction/ knowledge utili- 
zation process? Are the v^'quired resoiircps available or obtainabie? 

Integration - - With what other technologies or aspects of the R/DW 

system must th§ innovation be 'intag-rated or^coordinated? What modifi- 
cations in the aKisting R/ Dckli s ys tern or specif ic, technologies/facil- 
Ities.must be'made for the innovation tcr be ''ut i llzad ? What other ^R/DficI 
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system technologlas and facilities nnist be "in place" befDre the = 
Innovation can be ''developed', produced, disseminated, utll^ed? 

B , Ch ar 3c_t e r l8_ t ics oft he Innovationa , 

We will also want to eKamine Innovationa in terms of their various character 

[.sties. Some important issues^ could^be; " ' . 

\ ^'-^ ^ ' ^ ^ 

: ' ^ ^ ^ ' 

Life cycle - - How long will the Innovation "last"' before it must be. 

*\ 

"replaced"? ^ How quickly is the Innovation likely to beeome obsolete? 
Is there an "after-market"? . Are there legal/social factors .which 
cpuld limit the "life'J of the i4inovation? ' 

Costs - - What are the cuioulative cq^ts (i.e., to 'develop^ produce^' dis- 
seminate ^ acquire 5 operate 5 maintainj provide support services, replace , 
etc,)? Are the costs spread or coficfentratipd in terms of: r/d&I func- 
tions; particular organizations? ^ ^ ^ : 

Testabilitjr - - Can the innovation be tested? With what degree of cer- 
tainty? At what point in its development, praductionj Implementation? 
By whom ^n it be tested? ; 



Usage: specialized or generalized - ^ Is the inndvatlon one which can 

only be used by a few people or institutions .(because of "s^lls or ^ 
facilities required; CQsts; limited interest in using the innovation;, 
applicability only a limited type of situation)? Or can the inno^, 
vation be used by many people in a wide variety of settings? IW the 
innovation ^ertaine only to a single sector? Can tjte innovation' be' 
modified for mqre widespread usage? ^ 

.Type = - Is the innovation a *'ha^ware" iteig, "software" i£emj a process, 
etc. ? • . • . , ' 

Congruency - = How well does the innovation fit in^o^eKis ting processes, 
4:echnologies 3 ■ f aciirtles , . ate . ? , " & 
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Co^laxlty Ii the irindvatloiji relatively st^le 'or con^lex? Whiat level 

'of eempiex^ty Is Involved In implementation/utilization and implemen*> 
= tatibm/utlllEAion support Mrvlces? ' ; _ 



Quality * - Mh^t ^evel of quality Is needed? Is the level^of quality 
requirement imposed by the nature>6f the inridVatton Itself ^ by userg, 
'by governmental laws/regulatldns , Sy gafety eonsldaratlons , ete. 7 



Safety - T*^at are the relevant safety considerat^ris? How do they 

effect the innovation Itself jor the proceMes of developing/producing/ 
Wtil lining the Innovation? " , . 

■ * ' . ■ ' ■ ^ 

Reliability - - What i*s the range of the reliability of the Innovation? 
low reliable^ must it be? 

C, Impact and Benefits o f the Innovations ^ « 

^ — = _ ^ ^ 

^ ■- _ i 
Who benefits f^om/ls impacted by the Innovation (users , peMonnel^ envi- 
ronments etc-p)*?' . ^ 



What is the nature of the banaflts and/or the intact? ' - 

Are there negative "side effecta''?^ What are they? Who or what aspect of 
the R/.D&I system Is negatively affected? Can "the negative effects be 
controlled? Are they ■'acceptable"? ' . ^ 

Are the btenefits short term or long term? How quickly and for what con- 
tinuing period of time will the innovation have Impact? Does the time 
frame'for benefits/impact differ relative to different R/D&I functions , 
different Institutions, kifferent R/D&l system needs and issues? 



/ 
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.X. * ^ NEED IDEOTIFICATION 

Need identification Is an R/D&I function which la critical to any R/D&I system 
or fynctton. Thus, while there is a certain logic in considering it as the 
"first"' R/D&l functian, it is ^very impoortant' to no^ that need identification 
may be done In a variety of ways (e.g.: market research; formal or infortaal 
user fee3back; etc.); may be done by a variety of, persons or institutions 
<e ,g, ; users ^ producers , dt^s eliminators / etc • ) ; and may be done at any ^ 
stage of the R/D&I process (ile., during the performance of any R/p&I func- 
tion - - e*g.: during research, €evelopmentj production^ utillEation, 
etc.), ThuSs the key questions are: What/how? Wherel Who? When? Addi- ^ 
tlonallyj we will want to know something about the characteristics of the 
need identification ptoce^s 



A* what/How ^-x- Need Identification Procesaes 

^ ^ ~ 



\ 



What are the initial need identification mechanisms? ^ 

What need identlf icattgn methodologies are avallablg? Utilised? Why a^ 
_ with what results? Are they appropriate? Why ar,e some 'methodplogies 
' not utilized? ^ . 

What ne^s can be Identified In tenna of gaps in the knowledge/technology 
base or in the personnel or Institutional bases?, 

What are the screening procedures? < . . " 

How are needs communicated (so that they lead to pdtenttal innovations)? 
From wh<^ and to "w^^^? . ^ 

,^How are "needs" translated into "solution requirements"? 

How are the various need identlf icatidn processes ^coordinated , orchestrated^ 
managed? - - ^ ^ 



98 



ERIC 



,H0^ dciea thje system CQofdlhate/medlate/lttt^grate differ^ of 
J^^f : - ^ "©e^dfl" (a-gV: baste researchers tend to 4efltte "needs'' differently 
^ V than do users) ? ? ^ • 

B# Where ^ > ^ Lbcl jof Neted Identij^eatlQa Proees&es ; 

tiis tt#€d tdentifleatlon^ ^ relatlwly / ' * 

.'f fei^ of the E/Dail system's Institutions , threughout^ the oyerari" R/D&l 

. system Itself* throughout the sector ^ or outside of the sectpr? Or Is | 

^ need Identification done at all these ■levels? ^ 

. - '' ^ . ■ , _ ■ ■ ^ ^ ' - - 

C* Who - , - Need Identifiers V , 



Institutions are the prima ry need Identifiers? Why?, ' 

Within, these Ins^tltutions , what .organizational units or positions are the 
prloary need identifiers? , 

What are the characteristics of the organizations and the personnel who are 
the primary need identifiers? 

. S # ■ . ° ■ . : . ' ' ■ ' 

. 1 9!r ' . - 

^ . ^ i . 

D. When - ^- TiminR of Need Idantlf Icajtlon 

Is need Iflentiflcation done at all stages of the R/D&I process? 

Is need identification an ongoing. Iterative process within the R/D&l system 
- - or does it tend to be "one-time" and/or "one-way"? . 

Does the system attempt to projact/predlot probable needs "down the road" or 
, respond only to the "iranediate", currently "pressing" neeA? 

°E* Neej_ Ideiitlf ic^tlon Process Characteristics 



To ^at extent are the need identification processes formalized or Informal? 
Centralized or diffusei? ^ 4 
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Ate the nelS Identification practises responsive to user deinands? ' Do the 
pTOcesses ' attev^t to. create user awarerifess of needs? . 

Doythe need' identif icatipn^proceiies caoat resemble open or closed system? 

Have need identification procesies been stable or unstable over time in t#rms 
of the instltutionsp personnel,, mechanisms /methodologiea involy^^ed? 

* . i" ' . ' • ■ ' * = • , ^ 

Does the R/D6I system differentiate between the needs relevant to dijffarent 

/rXd&I functions, the R/D&l system per se^ and thqf sector served by the i ^ 
' R/D&I system? ' - ' . [ . . - / 

XI. . generation/reseMch, 



flp#6re Iboklng at the types of issues or" concerns involved in the generation/ 
Iresearch functionp we need to set a framework for our discussion. Firsts our^ 
concern here is 'with what may be called *-di#ciplined inquiry" (though we do 
not deny the possibility that new taiowledge may result by some "un-dlsclpllned" 
process). Second^ we use the double term 'generation/research*' to indicate 
that "discipliiied inquiry" is not necessarily limited to "researchers doing 
formal research in a formal research settfng", ' Thus, while our discussion 
below will focus primarily on formal j organized research^ it will be important 
%o know where /how/ by whom new>toowledge Is being produced outside of" th^ formal 
research setting- Third, we have deliberately avoided setting up a detailed 
"typology" for the generation/research function because relevant typologies 
Appear to be coritext=specific. We do find, however, some usefulness in thinking 
of generation/research In terms of three general types of processes: 

■ ' ' . . , - . % 

1. search (i.e,, determining what knowledge already exists); 

2* generation/research per 8e.(i.e,^ the creation of new knowledge) | 

3. * knowledge synthesis (i.e« , the re-combtnatlon of knowledge^ into new 

• ' ' forms - - which could be considered a particular type of niw-- 
■ " . ' . ■ -^j , . . ' . 

knowledge production). 
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' Furthari mead to exaaalne \the dlfferancaa betwaan ^4iat . are coranonly called ^ 
■ basic and applltd re3eareh« ^lla many pf the issua quastlons llstad balow - ^ 
i iflir be relevant to evaluation rlasaarcH^ we are traating avaluatlon research ^ * 

^' . = ' ^ = . - \ '^y ' ' ■ • * ' . ... ' ■/ ' 

aa a separata function, * J. . 

with the above in inimd, the following would'be .issues relevant t^ the gener-* j 
at ion/ research function, . " / . " * 

A/ Saaroh and; Knowl edge Synthasis Process Characteristics " . 

* Since the ganaration/research fuhction is focused on th^f^reation of naw know- ^ \ 

le4ge 'and oti extending tha eKistlng Ijmrts of the state-of-*the-art ^ thara is 
a preniun on avoiding **ralnvention" - - i.e* ^ on doing what has already - : f 
been lone ^ (Such reinvent ion'\ should' not be confused with "repetition" 
done for purposas of varification or with the rediscovery of knowledge^ , . 

which is difficult or costly to access*)" ThuSj soma ' important search 
Issues could be: = - ' 

What ls:-tha' available. knowledge base? ^ 

. ^ . . / » ? . ' ■ : ^ ^ 

What are the relevant basic disclpltniSs and how la the R/D&I system' s know- 
ledge base ''tied Into" these dlscipllhea? 

What are the InforTnatlon sources, channels of eorrariunicatlon and ratriaval 
mechanisms avallablfe fox: use In tire search process? How adequate are 
they? Which ones are usfed or not used? Wto uses them and who does \^ 

not? ' ^ " • ^ . . " . . /\ " ^ kJ 

Since knowledge synthesis is the re-comblnatlon of existing knowledge , we - . - 
would be dsklng these same questions in relation to knowledge synthesis* 
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* ■■ . - i ' -. t , 

_ B, Research pgQidiss Charaeterla ties . * ' V 

In order, to understand the research fiunction within an R/6fieI system, we 
will want to know about: ^ ' *. = 

what relative priorities are given to^ basic research (the search for know- 
ledge ?»for its own sake") or applted rere^reh (the seatch for know- 
ledga relevant to a specific issue or problem)?-^ . ^ - 

— ' = ^ f - ^ ' , \ ' ' - ' - " - ~ 

Is researeh being done by Individuals or by teams; within individuaL Insti- 

- tutions or in cross-ins titutional settings ; etc? \ 

... ~. . * * ■ • - .. 

- ^ ^-^ * '-^'^ . ' * . ^ ^ . ^ . ' . :^ 

What kinds of institutions are involved: public/private; pro£lt/not-f or- 

profit; unlvers i t y/ Indus try /^R^ organizatt ons /government ; etc. ? Where 

are £he "centers of excellence"? ' 

What methodolpgies tend to be used? What methodologies are tjte'most valid , 
reliable and feasiblt with respect to the type^ of Inno^^^lbn ftnd the' 
sector involved? ^ ' , ^ ^ 

Where 5 ^how and by "whom is "disciplined Inquiry'' occurring ojutslde of forpal 
research settings? With what Impaction R/D&I? . . ' ^ - ■ 

Is the research donf within a single disciplines or is it imiltldl*sciplinary? 

What Is the level* of maturation of the knowledge base and at the. reseai^ph 



- function in -a specific R/D&I system? 
^ ' ■ . ■ " ' ■ - * * - " 

What^cpmpetitlve d3mamlcs and patterns are involved in the research fucicelon 
(e.g,j Status; proprietary rights)?^ Involving what researchers or 
researchf o'^|anizations? 



'priorities? What is the rol^ of users in'the setting of research 



Wh'o contrplfi dieclslbns^ concerning funding of research; settlrig'of research 
" priorioles' 
priorities? 

■ , ' -1-02 
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what stability of funding, institutions, parsontiel Is hetfdfed? Doag tfili 

diffar aeross r/dm sectors or in terms of particular types of trino^ ^ 
^ ' *yat±on? What has bee© the patterti oE sueh stabl^lity? What level of / 
stability catt be prq/Jected for the future? ' ' ^ . ' ^ 

what Is the rate at which the research function can be bullt'up or *axpanded1 

what are the linkages between basic anrf applied , Research within the' R/DM 
aysteia? Mttween researchers? Between. research organisations? 
' Betw^^nr dlsclpllnesf Between R/D&I systanisT ; Are there gaps? Are. 

existing linkages used? If not,^ why not? 'By whom? ; ' - „ 

i ■ ^-'i' ' " ^ ' ' . ' ^ •■ ' ' ■ 

what differences o^ perspectives are there' between funders and researchers? 
What effect does^ this have on the research function? 

with respedt to, applied research s^what* is the effect on the/dual foci of ' 
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"research" aLnd^ "application'? ^ and of po^tentlal conflicts between "deslr^ 
abilitly'' and "feasibility"? 1 - ^/ 

How do the/ above issues differ between basle and applied research? 

j - m 

XII. DEVELOPMNT \ , , 



The development function Is that part of knowledge production which takes 
existing knoKladge' and transforms it into a form or format which can be 
utilized by users* . Develbpmetit is often understbod afe beginning tjhera 
research at^ops apd ending when the develppment. output»ia ready fow ^roduc = 
tlpn. In practice lirtkages to the research funcbfon may be weak/f and there ^ 
^may or may not be a clear separatlpn 'off^ the development and production 
runetton^'; v ^ ^ ^i^^ ^ : ' 

A, Thie Developer 5 ' ^ ' ' > * 

In a praetlc'al sense ^ d^relopment may ^e done by a variety of persons or i 
organizations » deluding users as well as persons trained In.de^lop*- 
ment who work In formal fievelopment organizations or organizational 
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, settings « Who the developers are may iTOp^ct 'the nature of the development 
- process and the" output of development 'Thus , ^ome ke^ ^ssuea could be: 

.- . « ^ 

* Is devslopmant being done by speciallEad development or R&D^^organlz'atlons , 
^,by a development department*, of ^an organization, or by users? ^ 

What Organizations are doing development?. Are they: private qr public ; 
^ profit or *nbt-f or-prof It ; large scale or small s^ale; sector-specific 
or sec tor -spanning? What Is, their coimnitment to the sector? 

What kinds and what levels of skills and technical sophistication do the 
developers need to have In relation to particular types products 
(developmeht outputs) being developed? What kinds and what ievels 
of technical spphis ticatiori do the various developers currently have? 

What Is the range or mix of development outputs on which the develdpment 
. organlzatlpn works? ' ^ 

To what external Influences are the .developers most vulnerable (*e.g,: high 
dependence on government funding in general or in relation to a parti-- 
cular set of govermnentjil agencies; fluctuations In priorities given 
jLo their particular'^ areas of developmental concerns; etc.)? Are the 
' deYelopers f leKlble/adaptable in ^terms of their- areas of focus, the 

clients whom they serve, their mix of techhqlogical skills ^ etc? 
" \ . \ ^ ' \ 

DO' the developers provide support services ^^Jo producers? To users? what 
kinds of support services? , .. . - \ ? 

B. Development Outputs t - 

While the outputs' of development 'are probably most corrandnly thought of in 
terms of "produc ta" , / It is importaut t^o realize that develppment" may result 
in a nij^mber of different types of outcomes (e.g.: programs, ^processisj . 
modelSj strategies, approaches, etc., as well as^ the narrower range, of out- 
puts we typically think of as "productS"J, Some important issues could be- 
^ ■ . % ■ -. ^ ^ ..... - ^ ■ ^ ' ' " — ■ ^ 
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Is thf Intended development output sl^ie or complex; lAt'ge scale or sna]Ll> 
acal'ei expenalva .or Inegcpenstve? What mix of tMhtiQloglGal^ikllls Is 
required? ' = * . • ^ 

* , ■■ ■ - 

Wh&t ark the in^lldatVons of the naCure of the product on*^ the nature of='* 

the devplopnient process requtredj the typi , mlK and number of person^ 
/^ nel .required; ^ the fea of pilot Nestings evaluation? 

/ • \ »^ . / . ■ / . ^ . ^ 

* ' ~ . . ^ .. > • ' . ' , * ' ' ^ 

Irtiat support materials (e,g.- Ini tructlonal manuali5 must be developad?^ 

What support Services (e.g*: malntenarice) will have to be provided? \ 

* 

At what point IjT the devflopment output ready for J^nltlal field testing? 
At* ^at poant has thei developme'nt output been sufficiently tested to 
permit prodw^on, dls semination and utiliEatlon? ^ 

User Focus qnd Linkage ' 

"* ^ ■ * ^ 

The en^hasis or focus 'of development Is the Intended or potential us%r* 
Developinent 5 then, iwolves a process of converting knowledge Intb us^er- 
ready outputs (with at* moat some minimal fitting and tailoring) that can 
then be. produced and distributed/marketed.' ThlSj in turnj clearly implies 
that linkages with t^ user are/ iraportdnt. Thus ^ some impbrtant issues * . 
could be I * / ' ^ ' » 

What are the linkages between developers and users? What gaps exist, and 
with what tmpacc?^ ^ « ' 

■ -V ■■' ■ ■ ■ r^-- ■ •■' 

What is the extant of clarity and certaln^ty in process of jieed identification 
(for development outputs) f Can users clearly speclfy^what they need? 
Do developers know Exactly what users mean? Is the developer then able 
. to say with assurance to the user: ''This development outpttt is what 
, you Asked, for''? la It then obvious to users what to do with the de-- , 
velopment output? 
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\' To what extent (and In what ways) daei the developer seek and ''receive addl- 
= \ ' tlonal "Information- from users during various |tages of the 4evelopnient 
^ pr&cesi? 

' To what extant is it relevant to focus ^eyeloproent on teohhologlcal oppbr- ' 

. tunlttes (i.e. J in thp eKpectation. th^at once developed , the output - 
will be seen users as "needed*^)? To what » extent do the Beveloper^ 
attempt to "forecast" potential uier "neids" for development outputs 
based on technolbglcal opportunities^ How is such "f oregastlng-- done? 
"By whom (i.e.: by the developers; ^by useyof coraultants; by producers; 
by marHieting departments; etc,)? V f ^ 

evelopment Stf te^ of the Att Linkages . . , . 

Development generally Involves modifying or improving an existing product 
(process 5 models 5 |etc * ) 5 o*' turnings a well developed concept into a usabte 
product. *Thus s development Involves using a relatively certain and established 
knowledge base* Some important issues , then, eould be- ' * . 

What are the linkages that developers have to^ the developmfeilt state of the art? 

How extensivte and established ia* the development k^^pledge "base with^^^spect 

to 'a particular sector, a particular type of development output? 

^ J- ' ' ^ . ^ " ^ 

Are Sevelopers creating development outputs which are In fact "out-of-date" 
because the state of the art permits superior ^u^tputs to. ^e developed? 

E p _ L Ink ag e a to P f odu jc t i on 

In the generic sfense, the inS of the development function la the beginning 
of the production function - , i<esj when a developma,nt output is "uier= 
ready's It Is ready, to be produced. (It imist be notad^ of course, that a 
clear cut separation of the development and product ^ functions does not 
always exist*) However, l^t cannot be de facto assumed that any '^user ready" 
development output is also "producer- ready" - ±,b. , that it ,is easy to 
produce* tHus', some important J,%sues could be f 
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What eotistralmti are therg In the preductidn function in relaftipn t'o* de- r 

. velopment outputs (e.g.i. existing TOanufapturlrig faellltlas afad t^eh-^ v " 
nologies. eannot produee the develdprnetit output; cost of modifying V^-^^v ' ' . J . 
or rap lacing axis ting aqulpmant^?^ - / • 

Alfa devalopsM awara of ^ production oonlty-alntsj ' , . 



What are the eomunlcatlon rinkages betwaan developars arid producers? j 
, > Davalopnaent Proeess ae ^ * > 

" Development m^' Be perceived as a .proceii, invblvlng several steps or Btages, 
though these raay differ depending ^on the nature of the product and on vdio Is 
the developer. Here, some Important issues could be- / 

. - ' ■ ' . . ■ ■ ■ ' " • ^ 

What stapg* are or are not needed? Are any "needed" st^ps being omitted or 
- ■ ^ done inadequataly? ■ ■ ^ ^ ^ ^ 

What ara the product and process design r#qulreinents? Engineering 

requiramanta? * , . 

What kind of quality Vj^Qntrol is done? 

' ' ' ^ ■ M 

What are the costs "^for the development process? ^ 

What ara ^'raallstlc time lines for development? WhAt affects the time llna 
(a*g,: nature of the output; avallaWllty of personnel, fuTidlng, 
* ' supplies; laws and* ragulations ; etc.)? ^ ' 

Who does/should do evaluation of developinent proposals ^ projeats , outputs^ 
- » i.e. 5 wiiat^should be the evaluation role of developerSj uflers, ^ 
i * .researchers 5 funding agencies, etc.? * ^ 
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N^' Is testing feasible? 'What does a test prototype coat? Are required tech- 
nologies and^ faclltties available? Are the' c^rlt^ria f|br^ evaluation 
simple and clear cut or complex and hard to define? * 
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Gan/should the development prqcess be dotie in clear and Separate stages? 

What deelslot^ need to be made at the end.of each stage? ' .. 

XIIX. PRODUCTION . ' Vv - * ^ - 

* , ' . ■ * ' . * '\ ' i 

The production funatlon is a erl^tlcal linking functibn within the over a,ll - 
flow of Innovation fro^ knowledge production To knowledge utlligatldn. The 
^rltioal Issue Is \^ether or not the productton function can handle the 
results of R6^. Thus, to do research and development without fiqnsldertng 
Aether or how R6eD outcomes c^n/wlll be "prgdueed*^ is to.rlsk slowing down 
the translatloh*df Innovatloni f tom Hcnowledge production to knowledge ' - 
utilization - - or even (at.woX'St) to risk makit^ R&D outcomes meaning- ^ 
less in relation to utillEatfion* ' ^ - 

In addition to the impact the production function can*have jon the overall 
R/D&I process s we may note that the designing of productloii systems is a 
process of innovation Itself Furthers we also sometimes find the develop- 
ment function occurring within the productioh function ^s efforts are made' 

to adjust production to R&D outcomes* - ' \.. , 

^ ' ^ ■ ^ . ~^ -. , ■ 

* - * ' .. ' * ^ 

A p Pr odtic t i on^ pr oc e^s e s ^ . ^ 

We will want to^eKanilne various aspects, of the ptoduetlon process. Some 
important issues could be: * ^ , 

How must tha product be designed so t^at it can be* produced with axlstijig 
facilities and eqlilpment? In order to meet specifications? In ordet 
to reduce iCQsts? What relative en^hasis is to be placed on cost vs. 
-quality fh product design? - - , 

What are the engineering requirements of^ production in relation to the nature 
of the product and the f acilltles/eq^lpiSent involved? ' 

■ ^ ' ■ ' . ' - ■■ ' " 

What" are the requirements fpr designl.ng the production system (e,g, : buildin 
facilities)? How is this designing done? By whpm'? * ' 
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^ViiBt are* the requirementa fior ^roductidn pla^nntng and coritrdl (e,g, : how 

many are to be produced in what order)? How might such requirements 

^- . ' * # - 

.constrain thi production of new innovations? ^ What TOtftods are used? i 

What ktnds^ of production operation^ are called for (e*g,: autotnationj 4 
assambly .line, coritlwoug process^ Intrlcite/ #ophls tleated vs. ' ' ' ' - 1 . 

. ' ■ - , . - ^ - , . ^ 

, uhskllled operations J etc.)? What sJci lis are needed? ' . . 

"' ' ^ .= ■ 

How, is quality control done? How rieoroualy? ^ * ' . . m . /%i 

B. Ch^ractpristica^f Production Processes ^ 

We will also want to examine various characteristics of production processea, 
Here some important issues could be: ^ 

What is the scale atid scope of production processes? Are the produc-tion prO'^ 
cesses of sufficient scale or scope to meet the requirements imposed by 
a specific R6eD product or to produce sufficient quantities to meet user 
needs? 

' What are the- technological characteristics of production techniques ajid facll- 
Itles? Is the available technology appropriate and adequate? Is .it. ''in 
place"? Does the production process require sophisticated technology or '' 

^ relatively simple technology? " 

What costs are involved? Does production require large or small scale capital , 
operation and/or maintenance costs? 

« 

Is production done in single or multiple unit processes? Are these continuous 
or separate? To what extent does the work of one production unit affect 
another? ' 



n 

What skills are required? 
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»Are production techniques and facilities relatively -'fixed", . ^ - ' or are they 
adaptlble and flexible? How is ada^tlbility/f lexibillty affected by the 
nature of the '^technology ; by the acale/scope of productionp^raqulreraepts 
^ anM coats? ^ / ' 

What is* the rate of change in the development of new production technology^ 

Is obsolescence ^a. significant problem? ^ * . ' 

Can parts of the production procesi be subcontracted? Are they? Which parj^? 

s ■ 

How do the above considerations vary across institutions within the see^^^^ 



How does the nature of the materials invoWed af f ect productiqn? Are the 

materials reactive? Are the materials ' easy or difficult to work with? 
Do they have, to be transported ^ stored? Do they have to ba ti^ansf ormed? 

Are^ the neeyded materials fvailable? , ' ^^^^ 

XIV. MARKETING/DISTRIBUTI ON/ DISSEM INATION/DIFFUSION 



An R/D&I systetn comprises all the functions related to knowledge produAoion 
(KP) and knowledge utilization (KU) , For R/D&I to comprise a complete system, 
there must be a "bridge" over which the work done in knowledge production 
can be "sent" to users - - or, conversely , over which users may dome to 
"find" results of knowledge production which are useful to them. Such KP-KU 
linking activities may be (and are) deacribed variously. Although no single 
descriptive term would likely tfe adequate to describe all such KP-KU linking 
activities 3 the following four terms or categories reasonably well capture 
the types and broadness of KP-KU linking activities: marketing (which d.s a^ 
producer-orietited description) ; distribution (wh^ch implies the methodology 
by which and the es^tent to which KP results are made available to users); 
dissemination (which has a more general, broad Information flow connotation); 
and diffusion (which implies a less proactive process than the first three 
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terma) • We racogriigaj of course, that these^ are not complefe^y 'discrete 

concepts and that, indeed, they overlap siinificantly- We also emphasize 

that tlfese KP-KU linking processes Include user-to-user user-to-knowledge 

producer coiffinunicatlons , * « ; ^ * ^ 

■ : "■' , • ' , ^ xj ■ . , - _ ' ^ , ■ : 

At Organizations , ' ^ 

A variety of organizations may bi^ involved in KP-KU linking .activities i pro- 
ducars who attempt to market products; users who actively look for products*; 
specialized marketlng/distributi^n/dissemlnafcion organisations , Thus some 
important issues could be: 

What types organizations are Involved In marketing/distrlbution/dissemin- • 
ation/dif fusion within the system or in relation to a particular 

KP output or set of KP outputs (e*g,r private/public; profit/not-for- 
profit; produce^s/users/intermediaries) ? What at'e their respective 
roles? 

What are the characteristics 'of these organizations (e.g.: large/stnall ; 
sector-specific or Sector-spanning; level of maturation; stable/un- 
stable; etc , )? ' ^ ' 

What level of priority and resource coimtiitment 'do these organizations give to 
^ marketlng/dlstribution/disseminatiotl/dlf fusion? 

B. Product Type * f . ^ 

The type and r^Eut ^oJ ^ the product being marketed/dis trlbuted/dissemlnated/ 
diffused affects the nature of the activities. We here include as ''product" 
any of the range of KP outputs such as methods, processes ^ approaches, pro- 
ductSj etc. ^ » 1 p , any KP '^output" that may be used by the user. Some 
^IpMrtant issues could be: , 

Are the products simple or complex? 

Ill' , ^ ' 
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Are there many or few products? ,^ ' 

Are- the products^^ ^^active? (For examplej acids react with some containers 
but not others; educational R&D products may become modified by the 
way they are used by teachers and students,) ^ 

Is ther0 a small or large "miK" of product types?- . 

How do the above conside^ajions'^af f e|ct the requirementg f or . marke ting/dis- 
trlbution/dissemination/dif fusion mechanisms and systems? . " - 



C, User characteristics 



^1 U 
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) 



The characteristics of the Intended user populatian will signlfdcafVtly in^ 
fluence the requirements and options avai^taile f^or nsa^'keting/dlsferlbution/ 
dissemination/diffusion. Here, some important/ isles' could b^/ 

Are there many potential users, or^qnly a iM^f 

Are the potential users relatively hotnogen&dus, or heterogeneous , in tec^ of 
needs J interests ^ acquisitlon/impleme^tatlon/u^liEatidn capabl.llties j 
i geographic location, type of, orgaM^atlonj etc.? . ' 



What are the entry points Intro the user system? Who wi'll make the acquiat-^ 
V tion decisions? Will these^ be^ifferent in di'fferent product types? 



What contjextjLial constraints are ^here in the user syatem (e*g*; lack of 
resources to acquire; burdensome fundlhg or bidding requirements; 
low levels of selection/ t,^sting/evaluation or implementation/utiliza- 
'tion capabilities)? /w , . 

. ./ 7 ' . ^ 

What level of awareness dq users have about a product; about their need 
for a product? 

119 
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Is it relatively easy or dlfflqult to identify which users ate the relevant 
potential target population? To identify/define the needs of various 
users? . = 



faJ^vatlbnal cons tr« 



Whab fWmvatlbnal constraints do the users tiave In terras of motivation to 
studyj test/ evaluate J imp lement^and/or utilize ia 'product (e.g.! tli 
constraints J training requirement^, prior bad eKperlenceSj etc,)? 



What "effects do the above consid«^atti^ns have on requirements fox marketing/ 
iis^tribution/dissjBmlnation/dififufi'ion mechanisms and systmis? ' On ppll- 



cies and strategies? 
D, Process Characteristics 

The marketing/distributian/dissemlnation/dif fusion function will need to be 
examined in terms of a variety of process, charac teris tic%8 . For eKample:, 

What kind of mechanisms, methods ^ systems are mos t * appropriate in 'relation 
to spec^iflc types ^of products #nd/or to specific types of users? 

What is/the level of user trurft in relation to the product^ the^rodticer, * 



th^ maketlng/dis tribution/dlssajnination/diffuaion system? ^ 

■ / • ■ - ■ - . ■ 

Under what conditions would dlfferfent .methods be .donsidered cos t/ef fective? 

' ■ k ^ ■ ■ 

What methods and chanAels are being used? Are not being used?. Why not? 

' ■ • : ' ' f 

Is the marketing/dis tjfibution/dlssemination/dif fusion jystem user-driven 

(i*e,j essentially controlled by users) or user-^orlented (i*e*, while 
\ user imput is ^ taken into account,- their input Is not determinativje) ? 

_„ System Levgl Considerations 

' As we noted earlier^ markating/distribution/dissamlnation/dif fusion is the 
.R/^D&I system function which in effect ''comp letas'' the R/DtSI system by pro- 

• ' 113 ; 
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Aiding a "bridge" by which the results of knowledge production ^functions 
can be made ^available to users. Thus consideratidn needs to be given to 
?'system« level'' issues In terma both of the R/Dfiel system and the marketing/ 
distribution/disseraination/dif fusion system,^ Sotne important issues could 

Whtffc^ i'^^^i^lev^l ^ R/D&I system maturation? ' How does this affect jhe 
nepd f orTrelevaflce of different' market Ing/d is tribution/^iss em 
. diffusion methods and approaches? ' . i ^ ^ ' 

What linkages exist between^the marReting/dia tri6ution/dissfeminatlon/dif- 
fusion on^the one hand and teBe&rchera/developersv^p''roducers /users on 
/ • the other? Are'^here significant "gaps" ,in ths syjtem?' 

-'What mechanisii^ a^e used for quality controls s tor ingj-'' retrieval , packaging 
dnd tailttfing? ? ^ ^ , ' 

XV. .; ACQUISITION / ^ 

The function pf acquisltlon^is the beginning of and can critically affect 
the know'iadge utillEation part of the innovation process. We will want to 
uhdei/stMd the acquisition function from, several perspectives* 

A. Steps j.n the Acquisition Process 

The aequtsltlon process may be seen as having several "steps"* However, 
in practicej these ■'steps" are not ftecessarily done In -'linear'* fashion; 
some may be 'given more attention than others; indeed j some may not rea41y 
be done at all* (And of couYsej other ""steps" could be co'^nceptualized, ) 
These steps ificludes ' . * 

1 , Awareness 




Do users tend :to be aware of their' need or of Innovations first? That 
is J does awareness of need lead'Users to search for innovations or 
does the.ir awareness of innovations create an "awareness" bf a need 
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In what ways do users become aware either of their r|eeds or of Innova- 
tioTii (e.g*; from need suirveys; pressure from the environment; 
critical eventa; publications J InforTOal communications; meeting 
marketing efforts of producers; etc.) 



2* Search 



What catJses' users to initiate searcii for Innovations? 



How/extenslfve is the search? - 
Is the search protess formalized? 
-Whc does the, search? 



3. Bidding 



S/reiqij 

Who determines the "specifications* 



Are bids us eft /required for innovations'? 



0 



? How? 



Does the biddlhg process exclude potenMal suppliers 

Testing ' ' \ ' 

Is testing of innovations done before purchase? By whom? 
How extensive are the tests? 



Do organizational personnel have the capability (training , facilitlas) 
for adequate testing? ^-'^ 

What are the rating criteria to''%e--tsed in testing? Who determines ' 
them? 
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Is tes ting done^' b)r the uaer organization *or by some other /Orga,nization? 

. 5 . Evaluation ' * 

What criteria are usedito evaluate an Innovation (apg,: cost; 
' , standards; ease of use; fleKibility of use; adaptabilityi to 

f other equipment^ products, facilities; efc ^ ) ?^ 

Who sets the^critferia? ^ ^ ' . ^ 

• - ^ ■ ■ - . r ■ ■ ' : 

Who makes the evaluation? ^ ^ ^ # 

6> Purchasing 

~ ~ * - - • a ^ - F 

Who makes( the decision tg^purchase or no^^ or from which producer ttO , 

purchase? ' ' 

^ I . ■ ' l 

r _ ^ . ■ - 

On what basis' are purchajSe decisions inade? 

Is purchasing -formaliz'^ (purchasing agent or department)? 

Are there any kinds of cooperative purchas ing/ leasing arrangements 

between ins titutlons ^ between agencies of a level of govern7 
ment (e.g*: police and fire departments), etc,? 

B* Role of Key Personnel in the_ Acquisition Ftocess ^ , 

As the above discussion has implied, the acquisition process is si^nif- 
leantly ^affected by wh^h personnel play what roles* Some Important issues 
could be : ' ^ 

What personnel are involved In/have authority overi the setting of criteria 
for testlngj eva^luation, purchasing; deciding what is "needed''; 
makl«ng purchase decisions; etc.? 

What capabllltjLes and perspectives do these personnel bring to the acqui- 
sition process? ^ 

, . IIG 



What are the roles of: producer personnel^ Intermediate age^ncy personnel 
(vendorSp professional assbciations , disseminators j "clearinghouses" 
etc.); "product champions''.; and user personnel (purfchasing agents, 
^engineers, higher level dfcision/policy makers, users of the Innova- 



tions) 



.Are the personnel who make purchasing dfcisions different from the person 
nel who will utilize the acquisition? Would the personnel ^who would 
- utilize the acquisition be capable of making technical evaluations? 
Do purchasing ,personnel use different acquisition criteria than do^ 
the personnel "^ho would utilize thT^mcquisltion? How are \ such dlf^ 
ferences resolved? ^Ith what effect on acquisition decisions (in 
terms of the val^^ of the acquisition to the personnel who must use 
^ the* acquisition)? 

C * Acqulj itj^on Proc es s Char ac ter is t ijes ^ 

Additional issues irivolvlng various charac teria tics of the acquisition^ 
.process could^ include: 

To what extent is the acquisition process formalized? Which steps? 

.What laws /regulations or organizational 'policies/regulations affect the 
acquisition process? / . , ^ 

Is the acquisition process relatively simple or complex? ^ 

Are the budgeting and bidding processes flexible or rigid? What time 
lines are Involved in budgeting and bidding processes? 

How do these factors affect, the potential producers /supp liars ? 

Is ,the acquisition procesa. centralized or diffuse? 



i ^ ^ ^ s ^ . . 

Ace there any inter-organliattpnal purchasing, arrangements? ' 

What capabilities 3o organizations need and have to identify^ select, test, 
evaluati innovations? * ^ = 

i 

What are the Intraorganizationfel linkages (e.g.: betwaen user personnel, 
engineers, purchasing agents)? What are the Interorganizational 
' "^linkages (e,g»: between producers and user Drganiz^tiona) ? 

XVI. lOTLElffiNTATlON/UTILIZATION > ' 

/ • 



Implementation and utilization begin after a user. has actual Ly acquired 
an Innovation, It is important to. ^realize that there are fome signifi- 
cant differencei between implementation and utilization, Essentially, 
implementation refers to the if^tftallation and Initial use of an innova- 
tiotip Utilisation refers to the continued , sustained use of an Innovation, 
While there is little merit In trying to delineate precisely where Imple- 
mentatloti ends and utillzatiort begins^ there are some significantly dif- 
ferent dynamics between the two. For eKample, during implementation, the 
user is dealing with a relatively new phenonemon; during utilization, the 
Innovation becomes "familiar". Indeed, failure during implementation may 
prevent (or at least set a negative "tone" for) sustained , continuing 
utilization of an innovation^ 

\ 

At the same time however ^ many of the relevant issues are very similar, 
and It is for this reason that Implementation/utilization is conaldered 
here as a slncle function. With an awareness of both the differences ^nd 
slndlarities between Implementation and utilization, the researcher ot 
policy/decision maker can determine (in a specific Instance) the extent to 
which implementation and utilization may be considered sinnjltaneously or 
need to be coneldired aeparately. 

The items below illustrate the kinds of Issues relevant to implementation/ 
utilization, 
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A. ImplementatlQn Processes 

Important Implemantati'fin process iasues could include: 

4= * 

% 

f 

Activities of producers/users/intermediaries to prepare for implementation - 
What training of user personnel is provided? What preparation must be- 
made for support services such as. accounting , computer prograDming? 
What suppliea must be ordered? Are organiEation development activities 

< needed .to prepare for implementation? , 



nitor/evaluate/modif y/f eadback Are these feasible? How are they 
done? By whom? What is the quality of the data received? 

The main issues for implementation, ^ then/ doncerfe^^^hat is needed and/or 
available; who is /should hk involved; how itnpleme^atlon is done; and what 
the effects of imp lamentation will be* % 



B# > UtlllEation PrQcesaes - * - 

Important utillEation process issues could include: ' ' ^ 

' 1 1 9 \ : 



Instaliatldn What personnel skills , facilities , technologies, etc, are 
■J . . ' " ' 

required? ' . , 1 

Testing/debugging Does testing "destroy" or "use up" the innovation? 
What are the cost^^ of testing (to do 'the testing; of the innovation 
if it cannot be reused after testing)? Can testing be done through 
^■^^ simulation, mathematical models?^ 

Trial run Are trial runs needed? Feasible? Who does it (producers 

vendor, us4r:, etc*)? What are the objectivas of trial runs? What 

- f 

time and cost are involved? What effect do the t^ial runs have on ^ 
user receptivity to the innovation? 
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ExpansiQn/raplacament In what ways does -th&; innovation require or allow 
eKpansion of the organlzatiori|^v-da^^iIlti^ subpart ' 

services J etc* ? What ^does ^fhWi^nqyat^on replace in terms of previous 



technology j equipment , *pars'ann^ , '%fic , ? ' ^ ; 

• : r ^ • ' ^ ^ ^ 

Routinlzation/standardizatlon — How^is usaga of the Innovation routinized 
and standardlEed? , y ^ 

Monitoring/evaluation/modif Icatioti What, ;#re the processes for monitoring ^ 
evaluation, modification? - . , 

Acceptance/institutionaliz^ion Has the'-^tntiovation been.^ac^pted within 
the organization on a continuing ^ sust^Mned bag is? Has it been 
"institutionalized" (i.e*, has it become, basic/essential to the 
organization, or has it remained peripheral) ? 

Maintenance What costs ate Involved in maintenance? What support 
services, personnel, training of personnel must be provided for 
, ^ maintenance? 



Extension/ improvement In what ways can/will the innovatiori and Its usage 
be extended or improved over time? What will be required? Will * the* 
innovation be utilized in stages? 

_ - _ . . . - _ _ i . . 

Diffusion Is this icinovation diffused throughout the organizatlonj^ or 

is it utilized in only a segment of the organization? tf the latter, 

why? , . 

Ct Implementation/Utilization Process Characteristics 

Important implementation/utilization process characteristic Issues could 
include' • ^ if" 

Scope What is the scope of activities and system adaptatlpn required? 
What resources are needed? Who is/must be Involved? 

i 

Level of technology What level of technological sophistication is 
required? For what technologies? Is training required? 
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CQnatralnts What constraints exists Can these be remove^ or reduced? i 
How? At what costs? » ^ . ^ 

Accaptanqeyrajaction What actual or'^potential conditions will tsAd to 
affect the accaptance or rejection^ of the irino^vatton? . - 

Adjustments In what ways nmst the innovation ba adjueted in order to 
adapt it for usage in a specific setting? What adjustm^nti will 
ba calied for within the qrgan±Eatl0n? ^ ^ 

■ ' ' '■^ 

Impacfc Who/what organisational kctlviti^ will be affaeted? In what 
ways? What organisational changes will be needed? 

D, User Characteristics Influencing Implementation/Utilization . ^ 

Important user characteristic issues influencing Implementation/utiliza- 
tion could include: ' 

incentives/barriers ^ - What are the incentlvee and/or barriers for 

users in the process of innovation? What are the ''entry points" for 
innovation? Whatsis the history of innovation in the user system? 
Hcfw do thes^e differ between organizations and within specific organi- 
zations?^ ^ 

Capabilities - - What capabilities do users need for implementation/ 
utilization? Do they have or lack such capabilitlee ? Which user 
organizations ^and/or personnel? With jespect^to whi'ch aspect of 
implementation/lit ili^ation procfesses? 

Key user personnel - Who are the key user personnel? With respect 
to what aspects of implementation/utilization? Who are the user 
change agents and opinion leaders? 

Status relationships of innovation - - Does the Innovation provide status 
for the organization or organizational departments or personnel? Is 
there . pr'ofesslonal status associated with the innovation? 

• 121 ' ^ 



Organizational characteristics How do or^'anizatlonal structures , 
processes and climate impact upon implemenfeatlon/utillzatlon? 

* E. Producer Characteris tics Iiff luan^in^ Implementation/Utilization ^ 

Depending upon the nature of the innovation and the needs of the user^ 
organization, the praducer m^y be a "significant influence on imp-lementa=' 
tion/uti tlEation, Important issues could include: 

What need .does .the user have for producef help In implenientatton/ ; ^ 
utilization? ' • f 



What is the capability of the producer to provide such help (e.g.: the ' 

producer's ability to train user personnel; the producer's ' 
technical capabilities)? . .\ ^ ; . 

.Wliat is the willingness of the producer to provide such help? What 
, ^ Incentives does the^ producer have? Does the producer provide* such 
, ■ service as a standard procedure? Is the particular situation of 
special * In^ort^nce to the producer? 

F_g Froducer/Us^r Relajion8hj.ps Influencing Itnp lementartbn/Utilization Process eg 

Producer /user relationships may also affect the imp lementation/uttoliEation" 
process, Sotne linportant Issues could be:. ' ' 

What are the user's relationships with the producer? Is the user dependent 
on the producer? In what ways? Are alternative sources (producers) 
available to the user? Is the user aware of these alternative sources? 
If n^t^ why not? Does the. user "favor" one ' source over another? If so, 
why and with what effects? v ^ ^ ' 

■ . ■ 0 ^ 

Do organizations othfr th^2=the producer help the user implement ^iand/ or 
service the innovation? organization?^ What la the user''s 

rerationship with these organizations? 
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Althpugh It^ght be theoretically posalble to coneeptuallze an R/D&I lystem 
which Would be completely self -eontalnea, In riall.ty an R/b&l system and Its/ 
constituent InBtltutlona do require support servlceB from other systems, 
OrgBnlzati^ and/or sectors. The need for support sprvlcas will be relev/nt 
(thpugh different In apecm^ for a'll of the R/D&I functions. 

A. Support Serylce Rtqulrements 

i 

We wou^ld want to know the nature and extent of the R/D&I system'^ requlre- 
menta/needa for suppprt servlcas* Thuas'some Important Issues iould be- ^ 

what are the R/Mel systam's raquirerents /needs for support servtdeis^ig,- 
protection of propriatary rights; tasting and analysis; equipment; 
supplies; transportation, computar sar^lcas; malntananca servlcas; ' 
ate.)? " ^ A 

^HOw do these requl^amanta/naads dlf f ar 'aecording to laval of system raaturltys 
. R/D&I function^ R/DM ins tltutlons , type of innovation involvad, ate? 

What laval of sopl^^ tication and/or specialisation Is requic^iWLrt the support 
services? , 

What sarvloea ^re the R/D&I system or Institutions unayie. to provide for them- 
selves? What services should they not provl*^^^ ^ r ltselj|? Why not? 

How dependent are the R/D&'l system or institutions upon the^ support services? 
, What are the effects of such dependence? 

What combination of rent /buy strateglea (for obta ag support services) 

are most appropriate at a particular timej ur. ^ existing eondidlons, 
for a particular type of 'support service, etc.# _ ' 
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B ■_ _Llnkag€_s to support Servlees 

It would be in^ortant to know how the R/D&I system and 4ts Institutions are 
(or could be) linked to support services* Some Important issues could be: 

What linkages exist between the R/D&I system/ Institutions and the raquired/ 

^ • \ • ^ ^ ■ % ' 

needed support services? ■ 

Wiat ^ps are there? What is the impact of these gaps? 

What barriers /constraints to lltricage eKist (e*g.: legal contraints; slow 
payment by public agencies for services received; support service 
system not being interested in the particular R/D&I system or sector) ? 

G. Support Service Characteristics * 

We would want to know something about the nature and characteris tios of support 
services. For example:. ^ , , 

. ■ " ... ' _ 

Tp ^hat ixtant are the required/needed support services available or not? 
Are there significant delays in obtaining support services? 

^at is the level of technical capability of the support • service systems? 

What is the quality of support services available? 

What are the cos ts Involved? . 

it.: 

fWh^t are the sources of support services? Are there alternative sources from 

which to choose? If so, wKat are the significant differences between them? 
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. ■ ' . -/ , \ . ^ 

TKi eimitfation rsaearch function is often simply called "avaluation", Wa 
haya dellbairataly Ghoaen to use the te¥m i'avaluatlon rasaarGh" to indicate 
that whila avaluatlon is dona in relation to knowledge utiligatiQn, therd 
is a reiearGh/knowladga production Gompohent to evaluation. Thus, while 
avaluation rasearch is dofte to Inform fundefs, policy makers^ daGislon 
makers and managers^ i't does create, knowledge which (in turn) expands /t^e 
knowladge base for R/D£tl. . . / I _ — 

Ai Two Kinds of Evaluation Research 



Eyaluation research .may be eitfier of two basic kinds. On the one hand, it ^ 
may be dona foV the purpose of providing pollcy/dacision makers with data 
on wfe^ch thay may base dscisions to continues discontinue or modify a program, 
project, etc. — or simply to "evaluate" the effects of a program/project* 
In either case, the focus is on "end results", and the .evaluation research 
would usually be done only after a significant period of time had elapsed 
since the beginning of a program, project, etc.^ e.g.^ upon the com- 
pletion of a program, project, etc*, or at some regularly scheduled, but 
fairly long. Intervals (e*g*- annually). This kind of evaluation research 
Is often called "sunmiative" * . 

On' the other' hands evaluation research may be done on an ongoing basis during 
the life of a programj project, etc* Here the purpose Is to provide managers 

with data upon which '*mid-course*' , operational changes can be made as needed 

^ - . % ^ •," - --- --- - - . - 

This kind of ^valuation research Is often called ''formative''. 



There are potential conflicts between tha'two types oE evaluation research, ■. 
In surai^tlve evaluation research^ premium would usually be placed on avoiding / 
input which could alter the program, project , etc* ' - - - in order t^T avoid 
"contaminating" the research process* In formattve evaluation research, however, 
premium is given precisely to inputs which would allow such alterations. Sim- 
ilarly, the research designs tend to be different for 'these two types of ' 
evaluation research. , 
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-Seme Important issues could hmi ^ .'' 

Whtch kind of evaluation research is being done? ^ " 

* -. - - , 

are the objacttves of proposed evaluation research? Which kind of 
itfvkluation research is needad to accon^lish thaa$ objectivas? 
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If both kinds o£ avalua^ion jrasaarch are done, can they be dona within the 
same re search desigfti or must -the raaearch daBlgns be different? 
Would the research .evaluapora who do the formative evaluation research 
be able t6 be objective ajout the summatlve evaluation researfth? 

What are the similarities , differences and/or conflicts between methodologies 
for formative and summative evaluation research? 



At what points In the evaluation research process should formati^^ evalua- 
tion be undertaken? By whom? . 

What are the implications for avaluat ion research if the focus of evaluation 
Is short -term as compared to long t^rm? If the focus is on consequences 
related to the Inmaedlate user as compared to consequences related to 
r society? ^ - 

Signlfiqant Participants ' ^ 

Evaluation research Involves a number of different participants , each of 
whom ma^^ have somewhat different (and potentially conflicting) objectives^ 
needs i i^erests, etc*"^ Thus^ aome lmportai;^^estions could hmt 

Who are the ^gnlficant participants (e^,g,i the evaluation researchers; 
fundera; policy makers ; decision makers* managers; ,ataffj external 
political or pressure grtups)? 

At what levels or in what parts of the system are the participants located 
(e,g*: localj atate/^ federal levels of government; top level, managers ; 
functional managers)? • 



«5 ry 



- 1 



. what are the lnforiatloo.^naads, perapectivas^ "vested lnteica8ts*% oisjectlvesj 
^ of the partlGipanta? To what extent" and in i^iat ways are these . . 

> pMBpBQttymm^ BtQ^"dtf£Btent ov conflict? 

* " " I ° ' ' 

What is the nature and history of ^tha relationship between th^ participants 
(a/g«i collaborative s conf lictuali none , etc,)? 

■ ' ' , .... . 

Who controls the problam daflnltian (i.e.i decides what is to be resaarched , 
and avaluated)? - , 

Who datermines what eriter^a^and methodologies are to be used? 

Who determines whose InforniatiQn naads wil4/will not be met? ? 



Who has access to tha avaluation rasaarch reaulti? Who determines access? 

Who datetmlnes* how the evaluation results will be used? 

What is tha/^ole of the evaluation rasaarcher in detemining proble'ta 
leflni/tlons critarla, and access to results? > * 



What skills do avaluation researchers need to have? Do tha^e sklli raquire- 
mantsr differ for the design^ data gathering, data analysis and data 
reanalysis stages? In terms of types ^of 'innovations? Do the skill, 
.., requirements differ between formative and summative evaluatidn 
resaarehers? - ' 



,tfhat is the training and backaround of the evaluation research 



era ; 
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C« Type of Program or Project ^ ^ 

Evaluation rasearch is done in relation to aome specific program or project 
(gor^ services etc .)% The nature of the program or project may-affect the type 
'.of evaluation research that is releM&nt, the eKtent ^to which it^is {eaaiblAj 
the reliability and validity of results', etc . Thus , sdme^ important issues 
' could be: * ^ 

Wh^ is the nature of the p^gram or project (e.g.: larg^ o^UfT^ll scale 
number and type of people involved in or affected by; lev^ ^thiti 
system; social service or physical sclence^_ based ; length of tljcuey "* "' 
ibefore "results" can reasoriably be expected^ etc.)? 

r 

Are. the goals/objectives of the program or project clear? 

in what ways and to what Extent does the pature of the program constrain 
the feasibility, reliability or validity of evaluation rese^lch? 

Can direct >ieasurem^nts" of outcomes be obtainec} (or can they be dbtatned 
or^" ifter long periods of time)? Are '-secondary" or "prediptor" ln= 
dlcators ^ available? With what degree of reliability and validity? 

D_g Design Methodology and process • 

On the one hand j evaluation research utiliEes^the methodologies of many 
research dlsclp^llnes , ' On the other hand, evaluation research is seen by 
many as a distinct discipline Itself, In any event, the nature of the evalu- 
ation research design affects the results obtained. We may further note that 
because of ttfe variety of ^^rticlpapCs and the potent ial for conflict among 
them, the design process take| on sp^ial significance for evaluation research. 
Thus 5 some important issues could be 

y . ■ * 

What methodologies are used^ for evaluation research? 
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Tp mxtmnt are ^he methodologies valldateds replleablel In what £?e Ids, 

dlselpLlneSp aactors? To what extant does, the nature, of the program 
or orojedt (or the situational context) aonstradn valldntion ahd/or 
:. repilloatlon? -= ^ 

i ":*' ■ ■ ■ ■ ■ ■ ' . / . ■ ■ 

What are the erlteria upon which evaluat ton will be made? 7;^ 
How are the evaluation criteria devel9ped? By whom? 

Havii potential conflieta in data' interpretations, usage of results and i 
access to results been identified prior to designing the e^mluatlon 
i^research process? If so^ how will these conslderstllons be built 
into the design process ;^^^and/or ^at steps will be taken to deal 
wuh the potenti^al conflicts? * 



XIX. . RESEARCH ON R/PM 

It I3 important to Imow what research has been done (and what data has thereby 
been obtained) about R/D&i* This would Include policy research/policy analysis 
done for an R/D&I system institution, research on any of the R/D^I features, 

research on R/D^I systems in general, contextual analyses relevant to particular 

2 

R/D^I systems , and research on research (R ) * . . 
Some important issues could' be 1 

Control = \ Who detarmines what resaarch on R/D&I will be done, how will 
be done/''"^^o has access to data findings, how findings wAH be used? 

Focus ^ - On what aspects of R/D&I does the resaarch focus? 

Methodology - - What methodologies are used? What are the strengths and 
weaimesses 'of the methodologies? 
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Siope - ^ Is thd raaaarch narrowly or broadly focused? 



GenerallzablLity ]- ^ To whajt extent are the Implications of the findings 

generalizablb? , ^ ' j ^ 

« » . = . ■ ■ 

InetitutionallMtion ^ Are there research organizations or departmente 

which fpaua on research on R/D&I? Or is the research on R/D6?I- being done 
^y liiii vidua 1 researehars or small research teams apart from any ^ 
Institutionalised base? Is resaarch on R/D&I/done on a continuing 
or on an occaalonal basis? ' * 

developmental state For what aspects of R/D&l is research at a high or 

low level of development? ^ ' ■ 



Literature base ' - - How adequate is the literature in regard to the empirical 
and •theoretical bases for research on R/pSI? What information do we have 
7 about R/D&I? How valid and reliable is the in format io n? What "gaps*' 
exist? 

Util^^tion ^ ^ How have research findings b^an used (or not used)? Why 
.or why not? By whom? - 

Imp^t - ^ How have the rasearclr findings affected R/D^I systems? "^it are 
#the Implications of the research findings for R/B&ll For whichV^DM 
systems? For functionif or aspects of R/DSI systams? ' >-''^ JU " 

Control - Who determines what research on R/B^l will be done j how it will 
be donSj who will do it, who will have accfess to findings j how findings \ 
will be used? . ( . 

2 ^ 
R - - What research is being done (and' by whom) about the nature and 

process of research, on R/d&I? 



The Research on R/D&I Commnity - - What Is the need for encouraging the 
^davalopment of the ' comnmnitles of researchers on R/D&I? flow might 
this best be done in order to balance both short term;and long term 




SECTION TWO 
/ — — 



ILLUSTMTIVE CONTEXTUAL ANALYaiB 
OF SELECTED R/D&I SECTORS 

Chapter Thraa* The K/B&I Contaxt In the Education Sector 

Chapter Four: Tha R/D&I Context in the ClvlLlan Aviation Sector 

( .-' ' ■ . _ " ' . ^' . - 

Chaptar Five: An lilustrativa^Cross-SfeictoraL 
Comparatlva QonteKtual Analyals 
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THE R/D&I CONTEXT IN TOE EgJCATION SECTOR 



B^IROI ^ ^Te O F Wffi R/DM _SM™ 



2, 



3, 
4. 
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C# Funding Control 
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II, 



HISTO RICAL DEVELOPtffiNT 



A Nawly Institutionalized System 
Cr ttica4^^wflta^=^- . . . j „ 

B. 1972-NIE 



IIZ. 



INSTITUTIONM. BASE (NETWORK OF INSTITOTIONS) 
1* Parallal Subsystems Within the R/D^i aystem 

A, Colleges and Universities 

B, Quasi-public and Private Sector Institutions 
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D. Llnkkgsa Within Each Subsystem 

E, Linkages Betwean SubsyatQma 
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IV. 



COALS, POLICIES , STRATEGIES ^ 

1* Weaknesses ; " 

2. Histprical Patterna: ^ Ghanging Prioritiea and Decisionmakafs 

A, Stage One: Research En^hasis 
' B. Stage Two: Centralization and ^Short Term Emphaaes 
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V. 
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VI, 



PERSpNNEL BASE 



1, A Critical Weakness v 

2, The Sources of Personnel 

3, Some Seemingly Intractable Problems' 

4, Policy Issues 
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VIII- 



FUNDING 
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4, Instability 

5. In^deguatfe Data Baia About pistrtbution of Funding by 
Functions and Performer Organisations 

INFOroiATION FLOW - 



1, Anrong Educational Researchers and R/D6cl Personnel 

2* Wittfin the User System , 

3. Between User System and Research/ R&D Persohnel 

4. Trends and Initiatives . 



IX. 



INNOVATIONS 



^ ^ Widely Varying Attrtojtes and KP/KU Requiraments 
"2. High Development Cbs^s 
3* Product/User Reactlveness 



NEED IDENTIFICATION 



An Institutionalised Need Identification Function 
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n Structures 
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GENERATION/RESEARCH 
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A. "Disciplined Inquiry" * ' 

Nori- Systematic -'Research" ^ ^ 

C. The Focus of this Discussion 
Tissues and Problems of Educational Research 

How to produce Interdisciplinary Cooperation . - 
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, Research 
iEtblpal Issues 
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DEVELOPMEOT ^ 



g'lng Character of the Educational Research Community 
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(Using jthe Rigorous Development Model^ 

Development in the Education Sector ' 

Changing Patterns of Federal Support for Educational ' 

Development , 
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ACQUISITION 
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B. Absenca of Evaluative Information 
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■ IMPLEMENTATION AND UTILIZATION 



1, A Neglected Function 

2, Tha Knowladge Base 

3* Emarganca of Linkage Organizations 

4, NIE / 



XVII, 



KVIII, 



XIX, 



SUPPORT SERVICES 



1. Changes In Support Systetfi Patterns . ^ . 

2* An Inadequate Knowledge Base for the Support Service Function 

* ' ■ - , 

EVALUATION RESEARCH ^ ' 



itical Dilenmas 



1. Historical Context 
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. ,3. OrganiEatibnal and P 

A, The Evaluator'^ Rdle 
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CONCL USION • 'V 



♦ 



CHAPTER, T HREE 



THE R/Dlit eONTECT IN THE EDUCTION SECTOR I 



A volume-length andlyile^of the aducatlonal R/D^I dori^ la in preparation 
and will be on file at the National Institute of Education (NIE) * In ^ the 
ehapt at presented here ^ we suTmnarlze key points made in the lengthier 
analysia% Specifically, each of the 19 ointextual features will be reviewed 
beiow to describe the context for analysis of ■ the eduaatlonal. R/D&I system. 




It should b# noted that much of this/ analysis is based on Impress^ 
''sources — impress Ions derived from Immersioh in the litersware 
to analysis of key features the, educational R/(D&I system and tmpr^s|l6.ns 
derived firora the analysts^ perabn^l ^i^srlefices^'#nd familiarity with^the ■ 
educitlonal R/D&I and operating sye terns*' The lihgthier analyais ' proVldes. 
extensive citatipns^ fand other documancatlon, as well as some discussion 
of key points in nee'd of empirical verification. , 



I, ENVIRON^NTS OF THE R/Pgil SYSTEM 
i Vulner ab 1 1 ity_ ; 



A, ' A Public Base 



Of all thfe sectors we have considered in our comparative analysis ^ education 
ts dlea^rly the most vulnerable tha moat open to (and subject to) 

social and political influence , ^ ^^^^ As public service ^institutions sup- 
ported by public funds and administered arjid regulated by' public agencies ^ 
schools affect all subgroups of the population (as clci^ens and^vtakpayers) • 
Since the proportion of io.cal funds spent on public education tends to be 
quite highj schools tend to te ^particularly s a Lien t: to taxpayers, ;.For 
those taxpayers who are also' parents of school-age children^ the level ^ 
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of concern about school functioning tends to be even higher American 
society has been characterized by tremendously high expacCations for 
schooling. The business community, too, has been expressing great concern 
abotxt school functioning., bemoaning the poor quality of worl 



Dorce 

(24) 

preparation for the world of work* " 



Goals . ' 

/ 

Education, by Its nature, also has more diffuse goals than other sectors 
goals that are more subject, to value-laden Judgments, mislriterpretations , " 
and controversy; goals that are harder to specify, less measurable, and 
iiarder to use as performance standards against which to judge system 
performance. In comparison to other sectors, then, the functioning and 

effectiveness of educators, educational R/D&I personnel and the educational 
system as a whole are more likely to be subject to scrutiny and debate, 

C, Legitimacy Problems 

Contributing to the vulnerability of the education sector is th^ educator's 
legitimacy problems in claiming specialized expertise and 'professional 
Status. Compared tq scientists, engineers, doctors, or lawyers, the 
specialized trai^ll^g needed to function as a teacher or principal does not 
seem particularly awesome* From their own perso^l experience (as well 
^s close observation of the experience of others), the public has more 
familiarity with what the educator does (as compared to knowing what an 
engineer or a lawyer does). Therefore , part icularly for the better e Ijcated 
parent, there is far less of a gap in expertise between the general 
public and educators than between the public and professionals in fields 
with strong knowledge or technology bases. Similarly, compared to fields 
with well developed knowledge and technology bases and highly specialised 
development activities (e.g,^ engineering), there does not appear to be 
much of a gap in e^cpertise between the R&D persormel who develop many 
of the learning materials on the market and the teachers who develop 
their own materials, or even parents who peruse the materials used by 
their children. 
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D. The Nature of Educational Innovations 



Adding to the vulnerflbillty of educatlonai R/D&I Is the nature of 
educational ^Innovations 5 as compared to the more technologlal outputs 
of R/D6cI systems in other sectors, where R&D producta are easily 
packaged and Installed; where use tare iy conflicts ^^ith the values , 
attltudas, and sensitivities of operating systein^ persoimel ; and' ^riiere 
products can be expected to behave reliably In accordanee with their 
performance specifications (as long they are used properly) , Educa- 
tional innovations, in contrast ^ tend to involve ''people change" 
e.g.: creation of new capabilities or organizational strategies o^ " 
instructional approaches. They are therefore more likely to be resisted 

by the people who make adoption decisions and by those who must 
implement them. As ''people change'' products^ there is far greater 
raactlveness between product and users (both school personnel as 
intermediate users and students as end Users) * Therefore, implementa- 
tion is more difficult, and effects ar| far less predictable* Even 
t^hen effective, educational innovations are harder to prove effeatlve 
^heir effects are harder to demonstrate objectively and are therefore 
more subject to dispute. Further, there may be controversy over the 
desirability of intended effects. ' 

E. Weakness of the Scientific and Technological Base 

The weakness of the scientific and technologlcaL base of education and 
educational R/DSI is at the crux of much of the environmental vulnerability 

of this sector. Though it shares much comnon ground with the social 

sciences and pther applied social science fields as wellj education is 

particularly vulnerable here. For example, we may note the following = 

1* The development of a knowledge' base in the social sciences and 
applied fields like educacion involves res©arch on humans rather 
* than non-humans 5 and this raises numerous value questions about 

^ what should be studied and how;^^^' tho ethics of research; 

/safeguarding the rights of those studied; €jtc* 
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■ 2. It also entails greater uncertainties in the research situation 
since the humans studied (unlike rocks or molecules) have and 
' axercise free will' and are thus '■reactive" to Innovations* ^^^'i 
Therefore, reliability issues become particularly troublesoms. 

3, There Is also a greater likelihood of bias creeping in throug^ 
the researcher's own biases or the quality of the interaction 
between r esearcher and subject* 

'%. ■ * 

4, Experimental designs calling for randomization or various kinds 
of controls. are also less feasible with humans^ especiallj/ in 
field settings as opposed to laboratory research, - - 

2* Governajice Structures^ . ■ * ) 

A, The Value Problem , 

The value^laden nature of education and educational R/D&I is particularly 
problematic J given the governance structure of education and educat ional 
R/D&I, School systems are legally controlled by agencies in their 
environment* Both school systems and educational R/D&I institutions are . 
largely dependent on these agencies for their funding. Legal control over 
the operating system is vested in lay boards of education, elected (or 
appointed by elected officials) in each of the approKimate ly 17,000 school 
districts across the country. This lay control, its> relationship to 
^ political processes s and its extreme decantralization are factors of 
some consequence* Although professional (i,e*: the Superintendent) 
domi^nance of lay boards is the rules there are frequent exceptions* 
Especially In controversial arteas (e>^g* : buslngj sex education) , unlesa 

the Superintendent Is a person with strong leadership abilities and a 
clear vision of what he or she wants , coimnunity pressures can have a 

major impact on school functioning* 
B* Formal Governance Structures 



In terms of formal governance structures, the educational system in the 
U.S. is characterized by extreme decentralization* In contrast to 
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centraltzed gystama (as; in; France, for example) which have centrally 
prescribed couraes, teKtbopks and learning matBrlals, centrally developed 
^eKaminatlon systems, and extensive monitoring of school operations by 
school inspect&rs, each of the thousands of local school districts 
in this country Is large l>r. autonomous. Though legal authority to 
regulate schooling is vested In t^^governments of the states, few if 
any states .actively monitor schoot'^functioning, and on the whole , local 
districts are highly autortomous from state afid federal authorities* In 
operational terms^ decentralization tends to go considerably beyond the 
decision making autonomy of the districts. Within each district there is 
considerably autonomy at the the local school level, with the principals 
(and also 'teachers) having a great deal of leeway in determining what hap- 
pens in their classrooms. This degree of autonomy down to the school and 
classroom level is a factor of considerable importance in explaining 
why innovations that are formally adopted by a school district are so 
often not tmplemented in practice , or are so transformed during 

Implementation that they amount to little more than ''the same old 

^. . „ (51, 119) 
thing . ■ 

C, Funding ^ntrol 

In the case of the educational R/DM. system, the ultimate control over 
decisions affecting funding and t-hw: f uiy R / DM functioning la 

the Congress. Given the history of Congresses lack of confidence in the 
ability \Df educational R/D&I to provide a reasonable return on the taxpayer's 
investment, this has meant almost constant troubles for the R/D&I system. 



_Economic Forces 



Economic forces in the Environment of the educational operating and R/D&I 
systems have been felt particularly severely in recent years. On the state 
and local level, achool ftnflncing has become one of the paramounV issues " 
of the day. We find increasing numbers of cases of states and local 
communities struggling Lwer equitable financing formulas;- states cutting 
assistance to local districts as they struggle with their own financial 
difficulties; and voters in local discricta defeating school budgets and 
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bond Issues in an effort to sitave off further increases in local taxes. 
EconamiQ recession has also me^t a shortage of, slack resources in 
the private sector to Invest in high risk/ low return R/D&l activities. 

Y : 

4* Summaryi Weak Sug^orts, and Assertive Demands 

III all 5 we can characteriEe the environment of the education sector as one 
that tends to be weak in supports for the system and assertive in demands 
about what can or cannot be donej should or should not be done,' R6tD'in edu- 
cation tends to lack prestige or legitimacy or even a. strong demand for 
its products or its very existence. This seems apparent whether we focus on \ 
the attitudes of researchers and scholars in the disciplines ^ educational 
practitioners y la^en^ Congressmen^ or even the education research and R6£D 
communities p , The system appears to have developed no strong constituency of 
its own and is buffeted by the initiatives of various other constituencies 
able to articulate demands reflecting broad social , cultural, and political 
movements in the society as a whole (e.g.; integrbttons ethnic consciousness ^ « 
f emiSism) , 

The enviroment of the education sector ' affects virtually every, feature of the 
R/D&l system the definition of goals^ needs, and strategies; the level 

and quaUty of personnel, funding, and other resources that flow 4nto the system; 
and the functioning of the system itself (^at research problems or R6^ topics 
are attended to; the manner in which problems are defined; the amount that 
must be invested in early phases ^^f R&D activity because of the weakness of 
the knowledge base and the transforms between stages; the controls that are^ 
exercised over research to protect human subjects; the credibility of the 
research and R&D effort with different constituencies (as evldenGed for instance 
in the numerous examples of the black coiranunity's unwillingness to participate 
in survey research in the late ' 60s) » No other sector we have considered 

iir^our ^compar a t4-ve— anal-ysi^-4^= on£ronted_wi£ h_such__s^^ ^ _ 

pressures. None is as dependent on environmental institutions for its support. 
And none is dependent on an environment so inimical to its chancag for develop-= 
ment and maturation. !3, 4 X - 
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II , HISTORICAL DEVELQR^m 
1. A Newly Institutlonalizad System 

The devalopmant of Inatructlonal strategl^ and learning Adterlals has bean 
, going on as long as there have been teachers and students , and we can find 
examprea institutionalized educational research In this country over a « 
relatively Ipng historical pe^od* Nonetheless, we must note that Institu- 
tionalized R/D&l In education is only a little more than a decade old*. That 
* Is to say, new to the field of education Is institutionalized, linked R/D^I 
as an interrelated set of processes revolving around the development function 
and carried out by specialized personnel under specially designed organiza- 
tional arrangements. While the newness of a system may not be significant in 
Itself (few institutionalized R/DSI systems In any sectors are more than a few 
decades old), it Is a factor of some consequence when compared to the centuries 
of history and tradition that characterize the operating system of educational 
Institutions/ The operating system served by educational R&D is old in history 
and heavily ladart with traditions, norms, and values that run counter to the 
acceptance of outputs of external R6cD. 

Thus, the educational R/D&I system has not yet established Its legitimacy. It 
competes against traditional approaches to producing knowledges programs, and 
products for educational institutions and it uses scarce resources. Its 

methods and outputs have not yet proven their superiority to traditional methods 
and outputs. In many cases ^ the products of educational R/D&I appear to be 
clearly Inferior to c5nvent ional ly developed products* ^ 

There would seem to abundant evidence that the systemVs present state of 
maturation places it within the boundaries of the introduetory stage of 
historical development. It is a relatively young system. As we will discuss 
1 a t er _i n thl s ana lysis, many functional specialties of mature ^R/Mtl systems 
are almost totally absent in education. Those that do exist either lemerged 
as areas of specialization after the R/D&I system was institutionalized In 
tjie mid- ■ 60s 5 or were wholly transformed by the demands^of that System, The 
functional specialties provided in the specialized R/d&I institutions exist 
alongside of ^-^ and competG with similar activities carried out in 
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the other, older parts of the education sector. The system has been char- 
acterized by a high level of Instability in both macro and micro level 
structures* Neither its funding nor its personnel bases have been adequate 
to the demands of systen| functioning or appropriate to the quantity and 
quality of outputs eKpec|ted by the system's sponsors. The field's know^ 
ledgp and technology bast is inadequately developed. R/D&I functioning in 
education has been hampe^d b^ amorphousness of standards; ambiguities in 
defining work roles and requisite skills and compentencies ; , and inadequacies 
In Information flow. The knowledge producing and knowledge utilizing com- 
ponents of the system ^re poorly integrated. System outputs have been 
generally low, in quality* 

2. Critical Events , 



A. 1954^1972 



A number of critical events have shaped the system^ brought It to^lts current 
point of development, and continue to be felt as constraints on system func^ 

tlonlng. The most significant events in the birth of institutionalized R/D&I 

ii^ education are; (1) the emergence of the federal government as the primary 

sponsor of educational R/D€il In the mid-*50s; and (2) the enormous expansion of 

federal funding programs in the '60s. The most important legislation has beeni 

(1) the Cooperative Research Act (1954 and subsequent amendments) ; (2) the 

National Defense Education Act (1958); and (3) the Elementary and Secondary 

(39 93) 

Education Act (1964). * Through these pieces of Legislation, the federal 

igoverMent created major new funding programs and also created a* network -^f 
new Office of Education (OE) funded^ Institutions which were separate from the 
existing bases of R/D&l activity and external 'to the operating system. 

The new nety?ork of R/D&I institutions external to the operating system in- 
cluded: university-based R&D centers ^ regional laboratories established In 
the form of quasi-public corporations located non-university settings; 
ERIC clearinghouses I ESEA Title III demonstr^^^p centers; and various kinds 
of materials centers. Although both the labo^BBries and centers were ex- 
pected to carry out activities cpvering the fMl range of R/D&I activities ^ 
the academic locations of the centers suggested that they would be partic- 
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ularly well suited to conduct research and prototype development ; the 
laboratories as institutions apart from the research subculture of the 

aersitleSs were eKpected to be in a , better position to attract full-time 
lopment-oriented personnel ^ and were therefore eKpected by many to carry 
out much of the systaii's R/D&l activity fcriented toward full development^ 
testing, and packaging of prototypes into usable products and program pack- 
agee. As It turned outs especially in the initial years of functioning of 
the new network of ins tltutions , there was only a limited amount of this 
functional specializatlonj and (with some exceptions) the l^oratories and 
centers operated independent of one another's workj each attempting to carry 
out the full range of research^ development^^ and disseminatipn work connected 
with its products. Adding to this picture of minimal integration among system 
institutions, the > dissemination-oriented institutions in the system (e.g.^ 
the ERIC clearinghbuses, ESEA Title III centers ^ materials centers ^ etc) 
tended to define their agendas and carry out their activities in ways tha^t 

were for the most part unrelated to the work of the laboratories and centers* 
High quality outputs were expected to materialiae quickly from this new net* 

work of institutions and to have inmediate and widespread impact on school 
system programs and practices. When this goal was not achieved within only 
a few years. Congressional disillusionment set in; large numbers of lab- 
oratories and centers lost thair funding and went out of existence; and 
educational R/D&I ^ appeared to be in deep trouble. (there were 13 R6iD centers 
and 20 laboratories by 1967; by 1972, only 23 of these 33 remained; by 
1975, only 17 of the 33,)^'^^ 



The educational" R/DM system, as that system is generally conceived today , 
encompasses an institutional base considerably broader than the labs and 
centers and other specialized R/D&I institutions newly created by the Office 
of Education in the *60s, It^ includes work carried out in academic insti-* 
tutlons , in the private sector , in federal, state, and local agencies , etc* 
And recent analyses of the federal government -s sponsorship of educational 
R/D&I activities underscore how many different federal agencies and programs 
fund educational R/D&I efforts*^^^' ~ 10-.) pyture histories of ed-* ' 

ucational R/D&I, and especially federal sp^onsorship of educational R/]McI 
activity, are likely to meet the as ^et unmet need for analj^sis of significant 
patterns in R/D&I functioning in tjiis broader sat of R/D&I performers and 



144 



sponsors. At presentj however, based on available published sources ^ there 
is relatl'^ely little that we can say about how this broader system fared 
in the^-60Ss and early '70s* Still, whatever picture of educational K/D&l 
in these other settings may appear in some future histories, the visibility 
of OE funding for educational R/D&I in these years (in contrast ^to funding for 
much work from other agencies), and the close associatlori in the minds of. 
many (e,g* ; Congressional critics, practitioner critics ^ etc.) between the 
labs and centers on the one hand and the sum total of educational R&D on the 
other suggest that the successes, failures, and fate of the labs and centers 
in these early years might affect the broader educational R/D&I ^ sys teni and 
its Sponsorship for iome time to come regardless of whatever may be learned 
subsequently about the broader system, its functioning, and its outputs. 

The ups and downs in Administration and Congressional support for educational 
R/ Kel have had a critical impact on the system since there are so few other 
I bases of R/D&I funding. The R/D&I funding that comes from private foundations 
is small in comparison to the sums invested by federal agencies, (In FY 1968, 
private foundations provided approximately $7 million of a $192 million doc- 
umented minimum base of financial support for educational RfiiD. ^^^^^ For FY 
1975, private foundations were estimated to provide $57 million to $65 million 
of a total of $605 to $673 million of educational R/D&I funding :^ln this 
country. ^ ^^^^ ) Furthermore, potential bases of funding — the education 
industries, entrepreneurial firms, state and local educational agencies 
have until recently failed to allocate subscantial resources to R/D&I activities , 
and even now the amounts that come from these other potential bases of funding 
are relatively small (si/mewhere between $35 and $85 million annua lly) , ^^^^ 

B, 1972 ^'NIE - 

The educational R/D&I system .was given a brief reprieve from what appeared 
to be an inevitable premature death* Ir\ 1972, the National Institute of^ 
Education was created, and control over many of the OE-sponsored R&D programs 

were transferred to this agency (es those programs like the labs - 

and centers program which had come under Congressional attack) , NIE was 
given a legislative mandate **to build an effective R&D system*" Implicitly^ 
it appeared that NIE was to become the lead agency for the federal goverriment 
sponsorship of R/D&I in education and that its fate would become synonymous 
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with aducatlonal R/D&l — as had the OE-sponsored labs and centers program 
in the • 60a , ^ 

Unfortunataly, the Inetitute itself encountered almost imaediate problems 
: of its ovm, the moat serious of which were its appropriations strugglas 
with the Congress, In 19745 federal funding for NIE (obligations) was cut^ 
from ,$106.8 million in FY 1973 to $75.7 million in FY 1974, a figure lower 
than equivalent OE educational R/D€el program allocations had been since 196^^ 
The zero funding reconmaended by the Senate threatened the veYy existence of 
Nil and implicitly educational R/D&I in general.. Since 1974, NIE's funding 
status a|>peara to have stabilized (albeit at the rather modest $7Df mtllion 
level). Still, the key barometer of this relationship for^ the near-term 
and long=term future is likely to be the extent to which the Agency succeeds 
, (if indeed it does at all) in substantially increasing its appropriation. 

Nil has been in existence for only a few years, and efforts to contrast NIE 
policies and orientations with previous federal educational R/D&I policies 
are hazardous given how little evidence is available about federal 

sponsorphip of educational R/D&I activity outside of OE and federal funding 
targetted at institutions other than the OE-created labs and centers. Still, 
our observations and impressions of f e der a 1 ly^ s pons ofEd~ e^uc'a tironB:t"^/D6iI 
functioning in the pre-NIE decade and subaequent period suggest the following 
strong points in NIE's favor that seem to warrant mention. 

In contrast to OE policies in the ■ 60s that focused so much attention on 
the labs and centers, NIE policies and programs appear to have restored 
greater balance to overall system development. - By supporting both the tra*- 
ditlonal bases of R/D&I activity (academic institutions, private sector organ- 
izations and the operating system) as well as the new institutions that emerged 
in the '60s, NIE has been supporting sources of educational innovation that 
are both internal and external to the user system. NIE program funding em- 
phasizes not only research and development activity (as did OE in its funding 
of the labs and cehters) , but also dissemln^lon, delivery, and building 
Internal user system capabilities for need identification, development, 
implementation, and utilization* State education agencies have been taking 
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increasingly active leadershlp^olas in dissemination and in providing 
tachnlcal assistance to school systems, NIE has also^ been emphasizing the 
role of the state education agencies as key sources of leadership In these 
areas * 

But NIE has not as yet developed a strong constituency within the research . - 
and conmiunities and among the powerful edudation interests and lobbies* 

Consequently 5 educational R/D&I continues to be buffeted by environmental 
fprceSj with little prestige or clout of its own to buttress it against 
environmental pressures that impair system functioning. Educational R/D^I 
has been likened to a tree that is planted and then torn out by the roots , 
every couple of years to see how it is growing, i To understand why this has 
been so^ we must eKamine the environment of educational R/D&I, . 

III. INSTITUTIONAL BASE (NETWORK OF INSTITUTIONS) - 

Analysis of the structure'j of the educational R/D&Z system suggests the existence 
of several parallel subsyjBtems characterized by minimal specialization , consid- 
erable redundancy^ looped as well as adjacent clusterings of functions, major 
gaps between functions * and Inadequate linkages among subsystems as well as 
functions. The overall structure is diffusei much of it lacks formalization , 
and whatever centralizatioti or coordination might seem to be inherent in the 
dominant role of the federal government in R/D&I sponsorship is more potential 
than operational at this time* 

The focus of our attention here is on the network of institutions that carry 

out R/D6eI activities per se rather than either the superordinate system 

that provides resources and contraints and accepts system outputs (l*e*: the 

federal and to a lesser extent state agencies and private foundations) or 

the subordinate system of mostly sector =spanning organizations that provide 

support services (e,g,^ data processing service bureausj. equipment 

suppliers s .matotenance flrmSp etc*). . j» = , : / . 
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1. Parallel Subsystems Within the R/D&I System 



r 



n 



;'^^,The Structure of the edueational R/D&I system ia^ in reality, a set of three 
^ /parallel aubsystems. ^ 

Colleges and UMversitles v 

• ■ % . . ■ ' ' 

QfTa subiy^tem is made up of various organtzational settings located within 
^* < J %tha colleges and univeraities schools , colleges , and departments of 
. , education; educational research bureaus; various academic departmanta 
social sciences and occasionally other disciplines as well* and 
^j^Wiverstty based interdisciplinary research centers and institutes. 

Quasi-^Public and Private Sector Institutions 

A second subsystem parallel to the first is made up of the large and 
proliferating number of quasi-public and private sector Institutions . %^ 
currently engaged in educational R/D&I the federally funded 

regional laboratorlea j R&D centers., ERIC elearlnghouaes ^ materials 
centers, etc.; non-profit and for-profit reaearch corporations geared 
to the federal grants and contracts economy; organizations from private 
industry that have been making tentative forays into educational R/D6cl; 
and othera such aa publishers and audiovisuai firms that have strong^^ 
established, footholds in the education sector." . 




C* SEAs, ISAs, and LEAs ^ ' 

The operating system of State Education Agencies (SEAa) , Intermediate Service 
Ageincies (ISAa) , and Local Education Agencies (LEAa) are so .weakly linked to 
these other two subsystems, and often no redundant with them in the conduct 
of R/D&J activities', that we have identified the operating system as a thirds 
parallel stream rather than as the KU target of KP activities in these other 
two streams. ^ 
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D« Linkages Within Each Subsystem " \ M. , 



Within each of these subsystems there is some interactdon of a more 
or less inforTnal nature but far less than one would Imagine, given 
,th©! physical proximity of organizational units within the academic 
setting; or glyen the operating system's formal governance structure 
that would lead;;one to expect to find extensive interaction and inonl* 
toring between SEA and LEA personnel; or considering the coiranonal-i ty ^ 
of interests that wo^ld lead one to expect extensive cosmiunicatidn^ ^ 
among schools or between LEAs and SEAs , ^ 

ISAs represent a new development aimed at Increasing linkages among 
school districts, and between school districts and their SEAs, Aside 
from this ^one eKception (and even' here, only some states, have created 
ISAs ,and these tend to be quite new), linkages within each of the 
three suj>systems are incidental and informal rather than Institutiona- 
lized, permanent J and strongs Consequently, conqnunlcation and informa= 
tlon' flow are weakj and knowledge production :and, ut 11 Izati on are in- 
efficient and far less effective than they might otherwise be. Develop- 
ments in. social science departments tend to have relatively little im- 
pact on developments in schools of education, R££D activities in one * 
research corporation have little impact on R&D activities in others. 
As yet, local Innovations in one school district seem to have little 
impact on practices in other districts, 

E. Linkages Between Subsystems 

Equally (and perhaps even more) serious are weaknesses in the linkages 
among these parallel subsystems, The academic eotmnunity tendg to func^ 
tion In relative isolation from both the operating system and the re^ I 
search corporations that dominate R&D activity. Consequently, the re- 
search findings produced by the universities have relatively limited im- 
pact outside that subsystem. The operating system is linked to publi- 
shers and equipment suppliers in the private sector but otherwise general- 
ly develops its own programs and materials and tends more often than not 
to operate as though there were no educationai research conmiuntty, no . 
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relevattt research findings, and ^no^jilPrally developed R&D products 
and programs* ' ' ^^^^ The general pattern, in the regionai 

laboratories and the research corporations is to develop products and 
prbgrams In^relative Isoration frotn.elther the academic coiminlty and Its 
accumulated knowledge base or the user syatetn and its perceived needs and' 
constifa&it§, ThereNare notable exceptions , of course , and some strong v 
collabotatl^e^r.rangements have been forged in a number of Instances . (e,g, t 
NorthWMt Regional Laboratory in relation to school districts in its region) 
But on the whole, individual R/D&I Institutions and oi^ganisatlonal units 
tend to function in isolation, linked weakly if at alt to other instltu- 
tioris or units or ^ their imnediafee subsystem or other stibsy^ems in the 
maerostruc ture , ' ' 



A Linear Model in theory but not in Practice ' 
A. A LOW Degree of Functional SpeciallEation ' 

The linear model that^is now in general disrepute but seems to have been 
a. significant Influence on much of the early R/D&I thinking In the *50a 
assumed that a "natural" specialization of functions and a passfit-on flow 
of R/DfitI activity would emerge in the relationship among these subsystems. 
Xhe university subsystem seemed Inherently suited to research; the non- 
university corporations seemed designed to meet the needs of prograninatic 
development work; and the operating system was viewed narrowly as the 
target to receive the outputs researched in the univers itles and developed 
in the corporations* Functional speciali gation was assumed, -as were the ^ 
linkages j two-way interactions , and knowledge feedback flows rfequired for 
an integrated system. To whatever eK±ent the linear model may be accepted 
as a reasonable description of R/D&f &nfigurations in any other sector, 
empirical reality in the education se^or reveals a somewhat different 
picture. 

The relatively limited degreG of specialization and extensive amount of 
redundancy' that characterize the educational R/D&I system can be seen in 
the location and ciustcrii^ bf R/D&I functions in. tiie- various institutions 
that make' up the system. , Why groatost amount of specialization occurs at 
the basic research end of Mie, educational KFU spoctrumj with most basic 
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raae&rcH concentrated in the universities and especially In the academic 
dapartmentf* Some basic Easearch is done in some of the larger ^ wealthier , 
and more preitlgious corporlttiDns (e*g^i Educational Testing Service). 
But for the most part, basic research is the private preserve of the uniyar- 
slties. . : ■ ^ S/ 



Applied resamrch, however, is carried out in one form or another in 
reifearch Institutions or units scattered throughout all "the various typps x 
of organizational settings in the system the universities; the R6dD 

canters and regional laboratories; the research corporations; and even 
some of the strong SEAs and bj^-clty I^s that have the resources to carry 
out policy research as part of their long-range placing and monitoring . 
efforts, , * . 

The bulk of federally funded development work is car r tad out in the 
regional labpratoriea and the large research Corpora tions* However , 
davalopmant work in one form or anothar takes place in virtually 
all types of organizatlonar settings all three subsystems. Similarly, 
dissemination and evaluation contracts are being awarded increasingly, 
to institutions located in only certain segments of the overall structure 
..(dissemination contracts increasingly to SEAs and organiEatlons working 
with them; avaluation contracts increasingly to the research corporations) • 
Nonetheless^ dissemination and evaluation .activities j too, are carried . 
out ^ in one form or another throughout the structure, even in organiza- 
tional units within the superordinate structure of federal and state agenciefi 

If we consider the implementation and utillEation support functions j what 
little linkage specialisation exists to provide user system personnel with 
technical asalstance in building internal c^abllities or implementing 
axtarnally developed RM> products, tends to%e located either In new 
U-r^age and technical assistance organizations (generally small non-profit 
corporations) or in the hands of a small group of staffers from a 
laboratory or organization that is trying to install one of its 
products, ^111 s even here, careful analysis uncovers some linkage 3 
tachnical assistance^ and implemantation support activities in the ^ ^ -i^ 
universities 3 In some of the strongar SEAs, and In LEAs and individual 
schools well endowad with curriculum specialists and other specializfed 

personnel. ^ p ^ = 

J= X 
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qfrerall, then, functional apaclalization among education organtEations 
tands to be somet^at lifflited, with most of these institutions encompass ing 
aeveral R/DM functions* The pattern is not only one of limited functional 
specialization, but also limited specialization in substantive areas of 
R/DMr activity, Basic researchers tend to become specialists in narrowly 
defined research areas and subjects of investigation. However^ applied 
researchers, developers, evaluators, dissemlnatore , and Implementation % 
support personnel tend to be generalists within their functions e,g,i 
one year evaluating compensatdty education programs ; the next year 
examining the effectiveness of alternative dissemination strategies; the / 
next year assessing the quality of ERIC information analysis products, etc. 
Within a few months time, a single large R/D&I organization within the educa- 
tion sector may respond to^ RFPs and bid on and be awarded contracj:^^ covering 
the whole range of functional specialties and an array of topical areas; 
and some of the same personnel may be assigned to work on several of 
these rather different contracts, at the same time. Some of these . 
organizations may also 'be working on contracts Involving R/DM 
activities in fields of healthy personnel develofiment , social welfare 
prdgramsj etc. Clearly, this pattern is at coriaiderable variance from 
a sector like the avxation/kerospace industry where, there is highly 
developed specialiEation by function^ by components (e*g.i airframes^ 
engines, electronics), and gven by R&D problem areas (e,g,- wing = ■ 

stress analysis) , ' 

A High Degree of Functional Clustering 

EKamination of the clustering of functions within R/D&I institutions v 
reveals, not surprisingly, that basic research is the most 'specialized^ 
of the various functions and the least likely to cluster with any of the 
others*' This is attributable to the nature of the knowledge and tech** - 
nology *base of the basic rasearch function; the socialization and 
training of its personnel; and the values, norms, and mores of the 
university settings in which it takes place. If we ignore basic research 
and consider the remaining R/D&I Bjnctions, we find several form.g of. ^' 
both adjacent and looping clusters, . 
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A ilgniflcant amount of Gluatetlng aurrounds the devaLopment function 

e.g. I applied rasaareh. and development; development and dissemination; 

davelopmant and production of support materials for implamantatlon/ 

u 1 1 i 1 E a t i on J and e ven d e va 1 o pme nt / d i a s emina t Ion / Imp 1 emant a t i cm^e lu s t er ing v 

The Qlustaring la the outcoma of conscious policy decisions of educational 

R/P£el managers* A lass formalized version of the same kind of clustering 

(minus dissaminatlon) would he reprasantad by the creative teacher whd 

ganarates aA idea, gathers relevant Information ^ develops It into a 

teaching strategy and Instruct lonal materials j and then uses them In ^ 

her classroom. - 

Dissemination and implementatidn/utilization clustering is becoming 
increasingly frequent as a result of the knowledge base and personnel 
base that spans these two functions and as a result of the kinds of 
organisational arrangements that are being created by eKpllcit and 
Intentional policy Initiatives of federal and state agencies (e.g.- training 
programs for -dissemination and utilisation specialists; state creation of 
ISAs to provide dil semination and technical assistance services to school 
districts; Nil's Rfi^ utilization program; etc,)* 

Applied research and evaluation were a , natural cluster during the first 
few years of the Mergence of the evaluation research function^ largely 
because evaluation personnel were trained as researchers; were Interested 
in conducting research rather than evaluation; were forced Into evaluation 
work by the operation of the laws of personnel supply and demand; and 
tended more often than not to piggyback research projects onto required 
evaluation activities. As evaluation has matured and developed an identity , 
methodology s and personnel base of Its own^ this basis for the research/ 
evaluation cluster has been less prominent. Still, there are several 
examples of well-run RfidD programs where questions uncovered in the course 
of product or progr^ evaluations are turned oyer to research personnel 
for further Investigation oriented toward future development cycles for 
further product refinement (e,g, ' in the development of the Individually 
Prescribed Instruction Program by the Learning Research and Development 
Center and by Research for Better Schools). ■ = 



One of the newest clusterings to appeaT Is a utilization/research cluster 
that may lead to maturation of a practice-orlented rasaarch fpeclalty 

=_ (as Illustrate d by work now in prpgrass by the Center for New Schopls / 

t© dociiment and analyze nine l^k local problem solving projects supported 
by NIE) * , 

Equally new is a utlllzatlon/devaiopment/dlssemlntftion or utilization/ 
dissemination cluster evident in projects to Identify eKemplary practices, 
dociment and analyze them, use them as the basis for materials develops 
menti and disseminate these practices and materials to other potential users 
The configuration is changing somewhat as more and more reaouyces are 
being allocated to building linkages. Initially^ this took the form 
of temporary CO llabo^rative arrangements and Joint ventures for individual 
projects, joining together institutions with complementary capabilities 
or functional apecialties* Increasingly the consortia and networks that 
are being proposed and experimented with are intended to be permanent, 
" formalized Interface arrangements providing either horizontal Integration 
(linlcing similar institutions or organizations) or vertical integration 
(linking functions and/or subsystems) * It will be some time^ however, 

' . before^ we can expect to see the effects of these initiatives on the 

J* ^rjc^^j^f iguratlon of educational R/D&I institutions, 

3* -'Mginal^olnt ■ The Place of Large Corporations 

One further point should be noted before we leave the topic of the structure 
of the R/D&I system in education. Several large corporations appear to. have 
particularly strong positions in the grants and contract^ economy of the 
education sectpr ~ .e,g,j toerican Institutes of Research^ Rand Corpora^ 
tionj Stanford Research Institute ^ and' Educational Testing Servicfe, In fact, 
in the period FY\1973 - FY 1975, fewer than 50 organizations received the 
majority of NIE funding support. ^^^^ Still, the number of R/D&I institutions 
receiving funds from all sources Is substantial and it would seem unwarranted 
at this. time to suggest that certain types of R/D&I in the education sector 
are dominated by a few^^large institutions In a pattern resembling the aviation/ 
aerospace industry « However, we ..will be in a better position to assess this 
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question after the NIE KPU monltoting project provides empirical data about 
the individual institutions that carry out educational R/D&I activities, 
JjQportance for understanding the emergent configuration of educational R/DSI 
^ins t ItUt ian^ policy ini t ia t Ives a nd s trate g ies 

for macrostructure management . 

IV. GQALB, POLICIES, STRATEGIES 

1 _* _ Weaknesses ' 



Educational R/D^el has been criticized repeatedly for weaknesses in goal 

setting, priority determinations policy formation^ and strategy develop- 

^ (49s 73, .83s 103, 128) ^ ' 
Jsant. Given OE*s and now NIE's status as the dominant 

sponsors and primary influences on educational R/DMs it is goal setting in 

these agencies that must be the focua of our attention. 



On the most general level, the goals .of federal policy for the system have been 
reasonably consistent throughout the OE and NIE years. Using the current NIE 
formulations these goals. have been; to solve educational problems; to 



Improve educational practice; to develop the knowledge and technology base 
needed for these efforts; and to develdp an effective R&D system. 

However s when analysis p^roceeds beyond broad goal statements to .specific 

policies s programs and activities of OE and NIE (and, when special note is 

taken of relative emphases in budget allocations) , the picture that 

emerges is one of marked discontinuityj shifting goals and priorities , and 

policies and strategies that have not been entirely consistent with some of 

the system's goals. What has been lacking until recently has been adequate 

translation of broad goal statements into intermediate goals and objectives 

specific enough to guide priority determination, policy formation, and 

strategy development and speci'fic enough to serve a^s benchmarks for 

^ ( 126 ^ 

measuring system performance.'^ ^ Also lacking have been mechanisms to develop 
consensus on specific system goals, priorities , policies , and strategies 
among the various constituencies affectedt 

' ' ' ' 1 ^ 
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2* . Hlgtorical Pattegnsi Chansins Priorities and Peels idnmakara 

■ ; . ... .4\ . ^ ■ ■ ■ ■ 

Historically, thera has been a close ralatlpnshlp between the dominant ay item- 
goals and pr ior It iaB^ on the one hand, and the primary loeus of goal-settl^, 
ott the other* ' 

A, Stage One; Research Emphasis 

: In the late '50s and earlyi '60s when tHe dominant source of funding was 
the Copperatlve Research Act, system priorities were determined largely 
by the educational research coimunlty. The locus of goai-settlng was 
decentralized, scattered among all the various researchers and KP (toow- 
ledge production) institutions who submitted f ield-^lnltiated proposals 
aiid the prominent researchers who served on review and advisory panels. 
In .a reaearcher-dofflinated context, research was rather naturally empha- , 
sized, bevelopment of the field's knowledge base was the goal of the 
systemi funding educational research projects was essentially the 

strategy! and funds flowed primarily to the universities where educa- ^ 

' ' ^ (25) ' 

tlonal research parsonnel was located* ~ 

B« Stage Two:- CentrallEatlon and Short Term Emphases 

This pattern changed; drastically in the^mid-'60a ^^en OE funding emphases 
shifted from f ield^lnltiated research projects to more bureaucratically^ 
defined, mission-oriented ^ programmatic R6i)* The shift was gradual* 
When the laboratories and centers were first created^ each institution 
_ defined its own mission based on the arfeas of specialisation of its 
senior level personnal. Over time, however 5 with increasing OE use of 
RPPs and targetted research programs, the locus of goal=se^tting became 

' highly centralized as it shifted to key OE staff mambers"^ith some 

V ■ ' 

assistance from their advisers, whom they selected from the research 

"- - (25) * ^ 

and R6tD comnunifcias ^ ^ 

With the shift to a centraliEed locus of goal=setting, there was a marked 

Change in goals aitS emphases^ There was Xgss and less concern with the 
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field's knowledge base, and more and more attention to the shorter *^range 
goal of solving Imaadlate problems of the oparating system, 'Those problem 
areas: receiving the largest allocationg of funds <e.g,i Improving the 
academic achievement of low-income^ minority students) ^^^^^ were defined largi 
by social and political forces external to the education sector rather 
than by the dominant concerns of practitioners at that time^ or by the 
needs of the field's toowledge base^ or even by the state of development 
of the knowledge base to permit effective attack on particular problems. 
The bulk of resources went to the development function rather than 
research. The time horizons of the dominant goals were Insnediate and ^ 
shorts-ranged* The emphasis was on developing packageable products. 
Limited attention was devoted to, longer**term development of change- 
process strategies or resource building for erihancing R/D&I system 
capabilities* Concern with developing the field's toowledge and 
technology base had lost center stage and was not only slighted but 
many o^ the funding policies and str'ategies of this period were even 
inJmldLal to this goal. Considerable resources went Into building an 
In^^tutional structure for a new^ specialized R/DW system but 
^ little of that funding was used to develop institutional capabilities 
for longer-term system development* Proportionally less and less of 
available R/D&l resources flowed to the universities^ and more and more 
went to the regional laboratories and the proliferating non-profit and 

for-profit corporations geared to the marketplace of federal grants and 

^ ^ (1, 83, 93) 
contracts, ^ 

C* Stage Threei NIE and MlKed Strategies 

A. 

We made ;the point earlier that any complete picture of federai sponsorship 
of educational R/D&I activity requires consideration of a host of federal 
agencies other than NIE that despite NIE's role as lead agency for 

educational R&Ds its FY 1975 budget of $74 million represents only a small 
portion of the total federal FY 1975 investment of $513 million. However, 
there is little in the published literature that is helpful for developing 
a clear picture of the goalsj prioritieSj. policies or strategies of these 
other federal sponsors* Our impressions of the contrast between current 
NIE emphases and earlier OE emphases may need revision after some future 
analyses are written of R/D&I policies of all the relevant agencies over the 
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past decade or two. But , for the present , since NIE la the lead 
J^ency for educational R&D'' and the system's most visible focus 
of policy detarmlnation, It seams useful to contrast what appear 
to be the^omlnant patterns In NIE godl-settlng/pollcy determi- 
nation for the system In the '60s# 

GoalT-settlng and policy formation under NIE appear to present a 
rather different pattern " a riore collaborative mode and a mlx^ 
ed strategy of centralized and decentralized initiatives. Com- 
pared to the previous periods, the NIE approach appears to be 
less RSD=oriented and more market=oriented, jfliereas the previous 
patterns emphasised first developing the field's knowledge ^base 
(1954-64) and then solving educational problems through R&D pack-- 
aging of solutions (1964^1972) s the NIE emphasis appears to be 
clearly on improving educatlonal^practice, R^D activities still 
receive a very large share of available resources , but dissemi^ 
nation, Implemeritation/utlliEatlQns and building InternaJ, user ^ 
system capabilities receive considerable attention In the new 
strategy. The federal role in the KU=oriented programs ±b seen 
as largely, facilitating and coordinating, and much of the Inlti^ 
ative in goal setting and problem definition is decentralized in 
the State and Ldcal Education Agencies. Substantial sums are 
flowing to these State and Local Education Agencies j and several 

of the programs supported are oriented toward lQng--term capabil— 

(86' 

ity^builiilng goals rather than short-term product development* 
A significant amount of emphasis in the NIE strategy has shifted 

from product development and product advocacy to change process 

-J 

advocacy and change proc'ess capability developments 

Still, the older bureaucratic mode of goal satting appears to 

have persisted in many of those NIE funding programs oriented 

more toward the KP than the KU end of the KPU spectrum* The 

locus of goal setting in research and R&D has remained largely 

centralized in the hands of the NIE staff and their advisers 

from the field, with resultant continued dissatisfaction among 

the research and R&D communities about existing goalfe , priori-- 

ties 5 policies s and strategies- A number of initiatives hdve 

been taken to involve researchers from a few research areas in 

the definition of research agendas for their fields; (e.g.i 

^ ' ■ < ^ Q 

£ UO 



confarences sponsored by the Basic Studies and Basic Skills 
(132) 

groupe^ of NIE^ - ) . But as yet, the research and R&D comu^ 

nities have not' had anything like the Influence of researchers 

in some of^he scientific disclplinegv Increasingly, there 

have been calls for a strengthening of the research and MD 

-_^oraimlties_an^ the of mechanisms to permit the 

field to exercise leadership In defining goals and research 

(38) ' - ' 
agendas* We may, thenj In time see yet another me tamdrpho- 

>ls of goal-setting and 'policy formation in educatlonaLS/D&li 

with significant Implications for R/D&I priorities, strategies, 

and funding programs* \ 



V. ADMINIiTMTIVE PROCESSES 

As la typical o^ any newly developing R/D^I system, concerns for manage-- 
ment and policy making processes have taken a low priority as compared to 
programatic concerns* The dilenma Is classical. Those. who are most 
likely to^ initiate an innovative thrust are'least: likely to see the need 
for or pay attention to effective performance in the "mundane" problems 
of Institutional management and the "dirty" problems of policy making. 
This has been the situation in edusat^onal R/D&I,. Little attention was 

;iven In the past to such issues at the practitioner level, and manage- 
ent for educational R/D&I. was not seen as a major and necessary aspect 
of the agenda of federal funding programs* With increasing maturation, 
again as Is typical, concerns in these areas have begun to ap^ar. Problems 
of organizational design, personnel manag^entj project and portfolio 
selectdon^ control and evaluation ^ cash flow management. Information 
management, etc* have begun to plague managers and polipy makers* NIE 
has begun on a modest scale to support some studies of management and 
policy making processes in R/MI* The tiipe would thus seem ripe for a 
major expansion In research and training progrMs devoted tp upgrading 
thm quality of management and policy making processes. 

In this report, we will limit our comments to the above brief overview. 
In a later volume ^ we will provide a detailed discussion of the adminls'^ 
trative processes function^ at the generic level. Analysis of the admlnls^ 
tratlve process function within educational R/D&I per se, then, remains 
an Item for analysis at some future time. 

.159 



ERIC 



- 157 - 



VI. PERSONOTirr. BASE 



1. Ay Critical Waakn eas 

V . ■ . _ 

Thm^ personnel basa of the education operating system in this country is 

, (93) ^ 
well ovar three million, < However * relatively few of the Instructional • 

and adminiatratiye personnel ^ho staff this operating syst^ carry out 

significant R/DSI activity, and we will focus our attention here on the 

.specialised educational R/D6t I personnel base, ^ > 

The specialised educational R/D&I personnel base has undergone substantial 

development in the past decade or so. In comparison to the mid-' 60s p the 

' educational R/D^I personnel base has doubled- (perhaps tripled)* The best 

estimate was that theHft/D&X systm personnel base In 1964 totalled about 
(19) 

4,000 persons. In 1974, several estimates suggest a mean figure of 

about ICii 000 persons (estimates ranged from 8-12,000, and higher or lower 

estimates can be found, depending on one's definition of an educational 
C93) 

R/D^il^system) , Still, the personnel base of educatlonaT R/BSI may be 

the most critical system weataess - and the most difficult to overcome* 

V The literature suggests that the educational R/D&I personnel base ,ia In- 

(19 63 ' 93) ' ' 

adequate in sheer numbers; ' - ^^Is disproportionately concentrated 

^ ' ^ ' (63 93) 

In research, evaluation research and development; * ±^ critically 

sparse in dissemination; and almost totally absent in functional special- 

ties that are just emerging or have yet to emerge (e.g, i need identification ^ 

acquisition, and implementation/utilization support). The field suffers 

particularly from the lack of an adequate supply of trained or experienced 

R/D^I managers, or even an appreciation of R/D^I management as a function 

(35) 

that could benefit from specialized skills and training • 
2* The Sources of Personnel 



By training and professional background^ educational R/d&I personnel tend to 



come out of either the psychology/ sociology statistical research tradition ^nd 

(93) 

the university environment or out of sGhool system positions (e.g.: teachers 
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or administrators). With few if any training programs geared to producins 
a/Pfyl apecialists (and the few that have been available, geared, more to the 
pattern of acadeDiic project research rather than programatic development)! 
on-the-job training has been the primary mechanism for producing personnel^ 
with appropriate skills and qompetencias an. Inefficient strategy at 

bast. Some lr^iTra^ivei"K^ve bren~taken to develop trainini progr^s more/" 
suitable to the tiaeda of educational R/D&I functioning Ce,g,i dissemination 

and titlliEatlon training program supported by NIE) . But as yet, it is too 
early to detect a significant change in the character of the system's personnel 
base* ■ X^* 

3, Soma Seemingly Intractable Problems 

The recruitmaiit 5 training, and socialisation of a talented personnel base for ^] ■ 
educational R/P£e1 will require overcomirtg several seemingly intTactable prob- 
lems; for a^tmplei 

1, the low prestige of education^ educational research ^ and 
educational R/D&I; " 

2, the orientations of most of those who come out of university, 
settings toward advancing theory rather than improving practice; 
toward individualistic rather than team functioning; toward 
relatively homogeneous rather than heterogeneous personnel skill 
mixes; toward producing publications rather than products or 

programs; toward a professional rather than a bureaucratic style 

^ (28) ^ • 

of functioning and management; 

3, the complexities of/developing suitable training programs, given 
the ambiguity tha^ surrounds the definition of. work roles, requisite ^ 
skills and standards for varioiB' func^onal specialties in the field, 
and the weakness of th^u^ existing knowledge base; 

■ r\ 

4* the instability of R/D&I funding; ■ v 

J 

5p the insecurity of R/D&I positions compared to tenured university 
posts . ^ 
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4«, Policy laauaa ' r , ■ 

Thar e has be.a much crltieism of educational R/DM for itis failure to attract ' 
eminent Wsearchcrs and flrst-ratr younger talent from the dlflclpllnee. But is ' 
It poislbla to attract talenteCpers^nnel to educational r/d&I, gt^en the praaent 
poor quality of ^tem outputs and the resultant Inability 'to overcome the 
.ystem's low prestige? is It reasonable to try to Intervene now In the ' 
maturation of tihe system's personnel base? Or, Is It wiser to concentrate 
resources on a few key projects where the critical mass of talent already 
exists and Impressive levels of achievement are within reach? Will a few 
excltlns high quality R/D&I outputs do mora to attract talented per aonner than- 
resource-building strategies focused on recruitment and training? High level 
debate on these questions would seam to be In order, /leading, one would hope, 
to long-range planning of Interrelated product development and resource- ' 

building strategies €0^ speed .system maturation. 

■ ■ ■ w . ■ ' . 

Our knowledge of other R/d&I aystenis suggaata that the rate at which the 
personnel base can be eiepanded varies among R/D&l system functions. In 
rssearch (and to ,f lesser extent, development) , the rate is dependent on 
the nimber and si^e of the axlatlng centers of excellence (which alone 
can provide the training) and is a long term procesp. For the linkage 
functions (dissemination and to a lesser extent develbp^nt), training 
progrms can be developed at relatively modest levels of funding and 
personnel trained within a relatively short time frame* However training 
in these functions will be constrained by (1) rates and levels at which 
users can reasonably 'absorb their outputs and (2) the relative lack of 
codiMcatlon in the knowledge/technoloiy bases. Thus, merely investing 
dollars in training is not always wise or effective* 
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vVII, FTOPING 



The funding of educational R/D&I suffers from five key weaknesses 1 in- 
sufficient diveralficatlon of sources, low levels, scattering of allo- 
cations, instability and inadequate data base about disfcribution of fund- 
ing by functions and performer organizations. 
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1* Insufficient Plveralficat of Sources ^ \ . 

The federal government has become the primary spotisor of educational R/D&I. 
A smMll portion of overall . R/D&I funding Is provided by private foundations 
and. an infinitesimal amotAt is provided by state and . local governments and 
private industry* Several analyses of funding data are currently under 
Way, and the precise figures may need revision when these are completed. 
However, for the present, we can arrive at a reasonably good picture of 
the level and sources of educational R/D&I funding from the best analyses 
available to us at this time* According to those sources, in FY 1975s 
total funding for educational R/DficI in this country * from all sources*' 
fell somewhere between $605 million and $673'million Cdepending on what 
is included or eKbluded In a given estimate) , with $619 million the most 
likely figure* 'Of this total sum, approximately 83%, i,e,, $513 million, 
came from federal government departments or agencies * ^^^^^ The bulk of 
this funding is provided by the Education Division of HEW, with moat HEW 
funds obligated through the Office of Education and the National Institute 
of Education* Other federal agencies providing substantial sums for 
educational R/D&I Include the National Science Foundation and the Public 
Health Service (particularly the National Institutes of Health and the 
Office of Human Development). Additional smaller =sums flow to educational 



il activities through the Department of Agriculture, Department of 

Defense, Department of Interior, State Department ^ Department of Labors 

National Endowment for the Humanities, Smithsonian Institution, and^other 

federal agisncles* The remaining sources of educational R/D&I funding 

includes, state funds, $40 million ($30 million to $60 million); local 

government funds, $4 million ($2 million to $10 million); private founda-- 

tionSj $57 million ($57 million to $65 million); and other private sector ^ 

sources, possibly (but here estimation is especially difficult) $5 million 

(93) 

($3 million to $25 million). 'Greater diversification of sponsorship 

seems essential given the political vulnerability of educational R/d&I 
(and thus Its funding) in a climate of limited system legitimacy and 
lack of confidence in the system's ability to produce a reasonable return 
on the taxpayer's investment* Clearly, though, substantial investment 
in educational R/D&I by. the^ private sector or by state and local govarn- 
ments is unlikely unless imaginative new inventlves are provided and _bold 
new Initiative^ are taken 'to attract this new sponsorship. 



2. Low Levali 

:Edueatlonal expendttures by ;all ,le|/els of government amount to approximately 
$55 blllloja. Approprlationfe to edteSTTTona^^ account for only about 0*3% 
of that total. * The inadequacy of this ^funding level is underscored by 

eomparison with other sectors • |.g.: 3.4% to 5.0% of expenditures in the 
industrial sector for MD; 4.6% iiVi):he health sector; 1.1% in agriculture; 
and as mueh as 10% to 14% of the Deplrtment of Defense budget. ^^^^ 
Given the Imiaturlty of educational ;i/D&I compared to these. other sectors and 
tlie need for expensive capacity-building programs, the low level of funding 

lavallabla to support educational R/DStI becomes especially problematic. 

3, Sbatt^rlng of Allocations 

tfhe difficulties posed by low overall funding levels are complicated further 
hjt allocation patterns that tend to disperse what* little mon^y is available 
over a large number of projects rather than conceint rating it ^sufficiently 
b_n a few* Thri trend in recent years has been toward greater and great;^r 



cbncentr Ation of funding, as more and more projects and programs have lost 
funding and increasing numbers of federally supported R/D&I in.sti tut ions 
'ha^e gpna out of existence. Still, given the limited funding available 
an4 the high costs incurred by large-scale educational R/D&I programs, 
greater concentration would seem essential if effective programs and products 
are to be produced. . ' . 

4* Instability - ^ ' . 



Inatabilicy of funding has been one of the most serious problems confronted 
by the aducdtional R/D&I system over its brief, history . The early promise" 
of ample funding for educational R/D&I was clouded within only a few years. 
Funding fot jflif ferenb types of R/D&I activities has tended to ebb and flow 
with frequertt shifts and fluctuations in federal R/D&I priorities. Federal 
reliance oils, annual rather than longer-term funding cycles was a frequent 
cause of complaint in the early years of the system. While all federally 
funded 8ect|»rs suffer to some extent from such instability, the problem 
has been especially critical in the educatiorg, sector because of its relative 
immaturity, 
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Pleas. have been made for longer-term funding coiranttments to permit lo©g-range 
planning of complex multi-year projects, and ,some inbdif ications of funding 
policies in this direction are apparent. Still, it would seem that greater ^ 
lorig-term stability of funding will be needed ^to attract first-rate I 
. persoMel and sub-contractors to ideational R/D&I. 



5. Inadequate Data Base About Distribution of Funding by Functions and 
Perf ormar QrganizatlonB ^ 

As wa noted Just above, available data do suggest^ that scattering of 
allocations is one of the weaknesses r f 'educational R/D&I, As yet , our 
data base is inadequate to systematically analyze the distribution of 
allocations. However, NIE Is currently doing a survey of educational 
R/D^I performer organiEations * When this is completed, we will be in a 
better position than now It o estimate the relative size of actual funding 
allocations by functional areas of R/D&I activity. Thus, we will also 
be in a better position to determine the extent to which the available 
resources are apportioned in a manner that provides the appropriate 
balance among functions (taking into account the overall stage of develop- 
ment of the R/D&I system and any necessary corrective actions that may 
be needed to redress previously out of balance conditions). 

Various data sources available at this time (using somewhat different 

definitions and classification schemes) provide rather disparate estimates 

of the distribution of federal funding for educational R/D&I among groupings 

of functional areas. For Instance, a recent description of one data set 

for FY 1975 projects in the areas of early childhood and adolescence 

suggests that 80% of this funding was allocated to a category described as ^ 

applied R&D; 8% to basic research; and 12%, to a group described as 

(93) 

planning, dissemination, utilisation, and evaluation. Another data 

set (using a differently bounded data base and a different classification 
scheme) 'provides a different impression of the distribution of federal 
funding for educational R/D&I in FY 1975. Thesrt data suggest that knowledge 
■production, activities (defined here to include Research, evaluation, and 
statlatical activities) have received only 17% of federal funds, while 40% 
was allocated to a category describGd as applications roirmulatlonB (materials 
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developmant, policy foETOulation, dembristratlons ; and social experiments),^ 
and 43% to utilization (dissemination and Implementation actj^yities) , ^^^^ 
Still other even more recent reanalysea of these same data by NlE-s MD 
Systam Support Division staff,, suggest slightly different figures, and 
these reanalysea are still in progress. Data from the current NIE survey 
of educational R/D^I performdr organisations may be helpful in clarifying 
soma of the inconsistencies* 

The current survey may be particularly useful also for shedding light on 
questions that have arisen about the relative distribution of funding (from 
federal and other sources) among the various organizations that comprise 
the institutional base of the educational R/D&I system. NIE funding data, 

for instance j Indicate that more than half of all NIE awards between FY 1&73 

(93) ^ r 

and lY 1975 were made to fewer than 50 organlEations* it would be 

useful to have similar information about awards, from other sponsors of 

educational R/D&I activity and to then explore the meaning and implications 

of such data for understanding the institutional configuration of the 

system; the location and degree of cojicentratlon of certain kinds of 

R/D^I functioning; the distribution of R/Q&I capabilities (and implications 

for system capacity building); sponsor^perf ormer relationships within the 

educational R/Dfitl system (and implications for funding/procuremetit policies); 

etc. . 

A substantial data base is currently being developed and analyzed to shed 
light on such questions, and additional studies under NIE's Education KPU 
Monitoring Program are in planning* As more of this inforraatlon becomes , 
available, we will be able to develop a more complete plctiire and a better 
understanding of the funding of educational R/D&I* 

VIII* INFORMATION FLOW 



There arc three diHttncl: i.rif ormaUion riow syaUcniH in thu education ncctort 

V 

1. KP inf ormaLi.ou i:Iowf; amun|^ aducatl ona 1 runearcherH and RM) 

pGrsonnoi. ^^entirally working ti? orHaiiLzaU loiial. HcttinRB exturnnl. 
to the uHur HyjJtuiii; 

166 



FRIC 



- 164 - 



2. information flows among user system personnel; 

3* information flows between external research and personnel, 
on the one hand, and user system personnelj on the other. 

All three Information flows are weak and inefficient, Ea^h has distinctive 
problams that impeda effective conmiunication and information flow and tharefore 
slow: 

1, the cimulativa development of a high quality knowledge and tech- 
nology base for the field| 

2* the development and dleseminatlon of research and R&D outputs to 
solve educational problems; 

3* the utilization of research findings and R&D outputs in operating 
aystems, 

1. Among Educational Researchers and R/D&I Personnel 

The educational research community has a well developed formal information 
flow system 'that includes annual meetings of the AERA; primary publication 
outlets; and secondary publications that provide syntheses and critical reviews 
of the literature and that provide mechanisms which facilitate information re- 
t'rieval from written sources* However ^ sclent J^ic information e^hange in^ 

education is more unstructured, random, and far *less efficient than information 

f 96 97 98 99 101) 
flow in many other fields, ' ' ? * ^he educational research and 

R&D communities lack well developad informal communication mechanisms analogous 

to the "invisible colleges" that have been identified in some other fields of 

. , , (32, 33, 111) 
knowledge. 

Informal conmunicatlon networks are critical in order for a researcher in a 
given research area to be familiar with work being done by others that would 

be potentially relGvant to his own investigationM . Informai networkB are also 

critical to permit ro sear char b to contact otliur reHuarcliurH who can facilitate 

their information tJc;archGfi and miniiiuj^e random inf ormat ion- ^ coking i^nhavior* 

:i(i7 ) ' 
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Furtheir,- the absence of such informal coiranuMcation networks to structure 
and channel information seeking behavior magn^^ies whatever time lags, lack 
of adequate abstracting and retrieval mechanism^, and other problema 
characterize the formal information flow system the field* 100 ^ 101) 
Thus, the absence of informal networki handicaps tl^ educational researcher. 



The development of a cumulatives high quality knowledgebase ^or the field 
is dependent on improving the efficiency of information Mow processes 
but there are few signs of progreas in this direction. \ 

2, Within the User System \ 

Information flow within the user system is generally retardad by various norms 
and patterns of functioning that tend to isolate operating system p^sonnel 
fro^^one^anothsr : e.g.- anticollaborative norms that assume the creative 
teacher generHtas idaas and teaching approaches on her own rather than \ 
using ideas and approaches developed by others; timidity about discussing 
classroom problems for fear of being Judged inadequate; bureaucratic rather\than 
colleaglal modes of functioning that isolate the teacher in a classroom full 

of children and provide few opportunities for teachers to stimulate \ 

(26, 27, 119, 125) _ 
one another 5 exchange ideas , etc. Research suggests that most 

teachers do not scan the professional literature in search of ideas or salutions 



to problems, but instead rely on interpersonal eKchanges as their main source 
of inf ormat ion . ^ Given the fact that there are relatively few opportunities 
.for such interpersonal exchanges in most school settings. Information flow is 
therefore minimal, 

/ ' 

3, Between Us or System and Res_earch/RMj Personnel 



\ 



Information flow between user systiem pcrsorinel and research and RM) personnel 
in KP organizations exl:ornal to user systcims is hampered by even more serious 
problems diffaronccs in values; norms; ways of thinking and 

conceptualising problGms; ways of describing and basas for verifying ^ 
assertionB; usage patterns; litula'if any avarla]i in the journals or 
magazines they read (or i^ubllsh in) or the profusslonal association meetings 
or conferences they aULeiid; tiLc , 
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4. Trends and Initiatives 

Some prograss is being made currently to overcome the barriers to information 
flow within the user system and between user systems and external KP 
organisations. One important initiative is represented by NIE support for 
programs to develop internal problem-solving capabilities through organizational 
development and other participative renewal strategies (e^g*: the Local Problem 
Solving Program)* Another is represented by NIE*s active, interpersonal dis- 
semination arid technical assistance strategies to facilitate KPU information 
flows (e.g.: the Education Information Centers and the R&D Utilization Program), 

However^ despite AERA interest a few years ago in strengthening research 

eonmiunitles and ^developing more effective corranunication mecK^nisms analogous 

(3 8 ) 

to invisible colleges , the Asaociation has done relatively little to structure 

information flow in the field into more orderly patterns. There has been a 
vacuum of leadership in this critical ^rea; and in the absence of any 
initiatives to improve information flow among education researchers ^ the 
knowledge base of the field remains weak and fragmentary and R/D&I functioning 
remains inefficient and relatively ineffective. 



IX/ INNOVATIONS 



1. Widely Varying Attributes and KP/KU Requirements 

Educational products and innovations vary widely in attributes and attendant 
KP and KU requirements* They vary in the state of the art of the relevant 
technologies; scales costs, and level of Yi&D effort required; in type 
(categorized as hardware vs , soCtware); in target functions: in demand levels 
and life cycles; in quality and relative advantage over competing products 
and practices; in testability and comnumicabllity of effects; in complexity; 
in compatibility with user liystcm constraint?! and therefore u^ov requ Iremcnts . 



Given this variability, any attompt to provide a modal description of: 
educational products and innovations seems risky* However , to facilitatu 
comparison with other sectors in our analysis, it seouiB Ufieful to conHider 
a number of goneralisationB about educational innovatiunn that are probably 

169 ^^-v." 
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valid for the overwhelming majority of products and innovations in this 
sector. We have notad some of these points earlier in our discussion of why 
the education sector is so milnerable to enviromnental influences. 

2. High Developinent Costs 

Educational products and innovations that are rigorously developed and tested 
tend to have relatively high developmental costs. This is attributable to 
a large extent to the weaknesses of the existing knowledge base of the field 
and the resultant need for conducting an extensive amount of applied research 
preceding and during the development phase. Gaps in the knowledge base of 
the field entail more unknowns. Weaknesses in the relevant technologies entail 
more trial and error. The transforms between stages (from conception; 
to specification of design requirements; to prototype developmant ; to 
development of successively refined versions of the final product) are less ' 
efficient, less predictable^ more time -consuming , and more costly. 

3, Product /User Reactlveness 



Educational innovations tend to involve "people change" rather than installation 
of technology ^ ' As such^ educational innovations are harder to package, 

more difficult to market and get adopted ^ and harder to install. There is far 
greater reactiveness between product and users ^ and therefore the implementation 
prpcess is more difficult and more implementation supports are needed. Product 
and innovation management strategies for the education sector, then, 'if they 
are to be effective, must take Into account product attributes that are likely 
to affect user system willingneas to adopt and capability to implement a given 
innovation. At the present time, however, integration of KU requirements into 
KP planning and activities appears to be the exception rather than the rule. 
As a consequence, externa II y developed R&.D outputs have not been diffused widely 
or had notable impact on odurntional practice. 




NEED IDENTTFICATTON 



Overall, tiecd Idem l: 1 Cleat: ion in udueaLion L/ick?i cohnrencu and Htirongth. 
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I, Lackingr An Institutionalized Need Identl FunctlQn 

Need identification Is one of the functional specialties of mature R/D&I 
systems that is generally lacking in education. There are relatively few- 
examples in the education sector of systematic 5 ongoing analyses of routinely 
collected data, cyclically reviewed as part of an institutionalized need 
identification function focused on needs assessment, capabilities assessment, 
and long range planning. Instead 5 whetHer we examine the process by which 
needed R/DM activities are defined by KP institutions or the' process by 
which needed R&D acquisitions are identified by KU institution's, iieed^ 
Identification in education tends to be episodic (or, at best, attuned to 
- the annual funding or budget cycles of R/D&I sponsors) . 

In further contrast to mature R/D&I systems (where need identification processes 
are institutionalized in specialized organizational arrangements) , the loci of. 
need identification in education tend to be scattered throughout the R&D 
and operating systemfe and their environment == researchers, developers, R&J) 
entrepreneurs 3 R/D&I sponsors, and R/D&I institutions; policymakers and 
administrators at the federal, state , and local level of the operating system; 
teachers and other operating system personnel who interact directly wi^h 
students; school boards and their parent and comnlunity const^ituancies ; and 
perhaps most prominent of all, the Congress, the courts, and various social 
movements such as civil rights, ethnic pride, feminism, etc. 

Need identification in education, then, lacks formalization, and its openness 
to environmental influtpnce is so great that the system lacks adequate buffers 
against extremely high revels of demands too varied to be met adequately. 

2* Bases 



Several bases ol need identification are oporative in education^ 
t 



A p I n t u i 1 1 vc J ud grng n t 



Intuitive Judgmunt: Iai the basin oi what is prohabJ.y tlie Largest pr()]K)rl: ion 
of all need i.dentif Icat: ion in the suctor/ There are several. pat:ti-rnH of 
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intuitive need identification in educatiDn; spontanaous insight; soli- 
citation of^ staff or axpert opinions; comparing what exists at a particular 
potnt in time in the prograimiing of a ^particular R/D&I or operating system 
institution and what exxsts somewhere else. 

- B, Opportunistic 

An additional pattern of need Identif Icatidfn in education is basically 
p pp Q r t un i s tic in nature — the impetus comes primarily from the exist-^ 
ence of a resource and only secondarily if at all from the existence of 
a problem. The availability of a resource (e.g.: funding or a new tech- 
nology or an available talent pool) and its potential for use in a bene- 
iiiicial manner are what in fact suggests the need, 

C. Data - Based 



Probably the least frequent basis of need perception in education is etn^ 
pirical data* Two kinds of data-based need identification can be disfcln- 
guished: one-time analyses of particular pieces or bodies of data, col^ 

l*ected primarily for. some other purpose but used on an ad hoc basis to 

_ - - ^ 

identify a particular need or set of needs; and systematic, ongoing analyses 

of routinely collected data cyclically reviewed as part of an institutional- 
ized need identification and long range planning function* 

3^ Vaugeness of Requirements 

The process of translating perceived needs int^innovat ion requirements specific 
enough to guide research and development is bare^ evident in education* More 
often than not^ the need identification process ena^with a statement no more 
specific than '-'a program to Improve students' self ^concepts" or' '*a program 
to raise' reading achiGvemcnt levels", RarnLy does the need Identification 
process in education produce a probl.oiu analysis sufficiently de'tailed do 
pinpoint cither spGcif;ic nLuineuts in tlic jii^ob luiuat ic situation (or condition 
in need of change ) o r L: lie k 1 nd o i p r o \ i, r ani o r p r odu c t no c e s h ar y t o b r i ng 
about deoirad changus, 
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Givan the social science base of the field of education, there is a somewhat 



limited intellectual consensus on the one hand and a good deal of value-laden 



vagueness i.e. : the vaguer the statement of a needs the easier It is to 

achieve agreement. Needless to say this complicates the problem of 
articulating needs in a tnanii#r that translates easily into innovation 
requirements, \ 

Equally significant in its img^ct on needs art iculatlons education has an 
inadequate and uncertain knm^^edge base and an ambiguous technology. It is 
difficult to define problems or|to know what is needed to solve them,-. 
Conaequentiy^ people have a difficult time identifying and articulating needs; 
thus, people also tend to generate statements that are too vague to be 
genuinely useful. In those atypical settings where an eKtensive amount of 
need^ articulation occurs 5 there are specialized organizational arrangements 
to translate vague perceptions of need into innovation Requirements (eg,* 
R/DM organizations that use evaluative data on existing products as the basis 
of defining needs and planning RficD for future products; or R/D&I sponsors who 
elaborate contract requirements through mechanisms like the RFP) = 

4 , D eels 1 on S t r u c t u r e^ 

Probably the greatest weakness of the need identification function in education 
Is In the decision structures through which need statements are screened and 
appraised before R/D&I resources are connnltted* Lacking is an adequate data 
base against which to judge the feasibility of responding to various alternatives 
identified as needs for R/D&I activities ^= feasibility in terms of the existlni 
knowledge base; capabilities for meeting various needs; and marketability of 
various kinds of products to meet given needs. Lacking too are adequate mechanlsn 
for bringing together the perspectives of both the KP and the KU ends of the 



KFU system In education to Jointly define needs and priorities . and jointly 
congider existing capabilities to meet a given need by new R/D&I activities 
(or alternative lyj to adopt or adapt: existing products or programs 0rom 
the full array of available practices, programs, and products capabiu of 



disagreement over goals and needs on the other. This puts a premium on 




meeting that need). 
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5* Recent Initiative s 

Recent NIE initiatives have been directed toward strengthening need Identifi- 
cation processes* The dissemination and local problem-solving programs of the 
Institute are basically capability-building programs i the intent la to 
build lo^cal capabilities for problem definition and to link user system 
pCTSonnel to KP resources that can be applied^ to 'solving locally defined 
problems* Similarly ^ NIE's increasing use of invitational conferences to 
define research agendas and needed R/D&I activities has been motivated by 
the desire to bring the research communities from education and the disciplines 
into the need identification process with maximal efflclenty ~ getting 
simultaneoue input and feedback from the leaders of a given research area, 
and at the same time developing some consensus on priorities and disseminating 

these to the field (e.g*: conferences sponsored by NIE's Basic Studies and 
_ _ (132) 

Basic Skills groups)* However, as yet^ there is only limited evidence of 

overlap between the highest priority needs identified or acknowledged by 
practitioners and those identified and acted upon by external reseafth and 
R&D organizations* Consequently ^ need Identification at the KP and KU ends 
of the educational KPU system show limited integration, and the ■e^f#Jctiveness 
of R/D&I functioning throughout the system is limited accordingl|f , 

A hopeful sign is the substantial amount of effort currently going into the 

development and use of ongoing management information ^ monitoring, and assess^ 

ment systems on the state and national (and to a lesser extent even LEA) 
T , (31, 42, 80, 95, 118) 

levels. It is still too early ^^q^ expect to find sig^ 

nif leant impact from these new developments ~ but clearly , as assessment 
syitems and long range planning units get better established in the education 
sector, we should look for evidence of maj.or changes in the manifestation of' 
the need identification function in education. 



XI. GENERATION/RESEARCH 



The Eucus of thin DLscuhbis 



The term "research" mnv havo a va^i(*t:y of connocat Lodh and moaningB — and is 
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often used very loosely in the education sector. Thus , it is important that we 
first identify what "types'- of ''research" will be the focus of this discussion. 



A. "Pl scip line d Inquiry'' 

In this discussion^ we shall be concerned only with "fesearch" in the sense 
of "disciplined inquiry" the conduct of systematic empirical investi- 

gations or the application of disciplined qualitative inquiry approaches 
(e.g.t historical^ anthropological and political science modes of 
investigation) tfo^education'-relat#& questions. Who conducts the disciplined 
Inquiry is not at issue here the researchers may be those who identify 

themselves as educational researchers or as researchers working within a 
particular discipline. Within this frameworlCj we thus include both 
basic Xor "pure") research and applied research (i,e*: research oriented 
toward either product development or toward institutional and policy 
research concerns)* 

We recognize the limitations of the "pure vs * applied" usage. Still we find 
it helpful to think about educational research in terms of three 
categories : 

1# basic research; 

2, applied research 

3. applied research to inform policy decisions. 

We also recognise the somewhat arbitrary nature of our division between 
the forms of institutional and policy resGarch that we will include here 
and others that we will categorise later under the concept of evaluation 
research. 



in another analysis we used the descriptive term "problem-- focused 

research" rather than the morG common term "applied research" to highlight 
tHe differenr . n focus between basic and applied research. Here, how- 
ever f we will uy e the t e rm "applied r es o ar ch " b e c uus e ' o f 1 1 n common u s a [\ e . 
it- 
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Finally, we do consider thatj; properly concaived and done (i»e«* as 
"disciplined inquiry") jevalua^^n is a form of raeearch. Thus, we use 
the term "evaluation research" rather than "evaluation". However * 
because of its special nature and its usage at the utilization end of 
the R/D&I process, we treat evaluation reaearch as a separate feature 
latervi- , 

B Non^S y s t ema t ic * ^Re s ear ch* ' 0. 

We specifically exclude from our discussion of the research enterprise 
various quasi=research activities that are typically labelled as 
educational research and divert a fair amount of research funding away 
from disciplined inquiry^ bud use machods and serve purposes rather 
different from those of systematic researth e,g, ^ school surveys^, 

statistical surveys of the social bookkeeping varietyj social action 
projects s dissemination and demonstration projects j and development 
work* 

C^* The Focus of This Discus^s^lon * 

^ReseArch is only one of sever a 1 bases of innovation and product development 

in the education sector. Few of Uhe dominant educational practices in school 

are based on research findings. Insight , inspirationj and analysis of a 

relatively unsysternat ic sort are the bases of much conventional educational 

practice* wKere information is sought to guide translation of ideas into 

practices or mater ials^ informal interpersonal coirnnunication^o?^ more 

formalized library research ap|) roaches are considerably more common search 

strategies of the opera ting ays tern, than the conduct of systematic emplricai 

investigations or application of disciplined qualitative inquiry approaches. 
We know relatively little about these nonscientlf ic approaches to the 

generat ion/reseat"ch function in education, though this Liituation may 

change as increasingly more attention is devoted to documeritation and 

analysis of locai problems-solving titrntegies in the operating system 

(work currently In [)ro|^reMH by t\xo CJentei: for New Schools, supported 



We know considerably more .about the condlct of disciplined inquiry in ^th 
education sactor, and it is this disciplined inquiry that has baen the 
focus of R/D^I policy concern, 



2, Issues _and ProblemB of Educational Research 



The adycational research enterprise faces many of the aame dilenmas as research 
in othar fields aapeclally other applied social science fields. There are the 
universal issues of quality control of particular ImportanGe in 

education^ where evaluations consistently show poor definition of educational 
research questions; inadequate methodological, rigor; inadequate grounding 
in theory; and low ratings of the quality of most educational research 
outputs, ^^^^ ' There is also the omnipresent issue of appropriate 

methodology ' debated in education in terms of the strengths and weaknesses, 

of experimental (or quasi-experimental) vs. the less controlled designs iti 
thm field settings in which most educational research is conducted, ' ^35) 
A related issue concerns the inappropriate application of various statistical 
techniques In data analysis. 



1^ 



Several of the generic research issues that cut across all social science ■elds 
(and perhaps other sectors as well) are partlcujla_rly prondunced in education 
because of the nature of the field's knowledge base, the nature of the demands 
made on the educational research conmunity by external envit'Orunental forces, 
and the deep strains in relationships betwuen researcher^ and practitioners, - 
Instainces of these generic issues that take on particular salience in education 
are I how to produce interdisciplinary cooperation; how to determine priorities 
between basic and applied research; and how to protect subjects and operational 
settings from unwarranted interference by researchers,'- 

Ai How to_Produce Interdisciplinary CQoperation 

Education is a conjunctive doinain o^Hcnowledge i,e. 
focuses the perspective's Bcvaral disc ip linos on undGrstandlai'; nnd 
solving certain social problems, ^ ^^^^ since an many as twelve ^(or niore) 
disciplines convurge on inquiry in uducacionj interdisciplinary coopuration 
and cooperation bctwacn aducatioiial rCiiaarthorH and researeliarj^ in Lhu 
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= other- 4-1 scip lines become all the more important but no liess "easy 

to attain. <. * 

_ By How to pet ermine t^r ior i ties Between Basic and Applied Research 

Ths^'^'de^ate between/basic and applied researchers in education is phrased 
in CB^ms of the \^aknesses of the field's l^ndwledge base (how 1 ' ^ or 
how tnuch^Nwe know at this time to guide program or product dev vn-a vs,. 
the inttflediacy of the problems in need of solution. Thus argUL. i be 
made in sijpport of basic research at the expense of applied researcu 
for eKample:^ the contention that R<ScD programs at this time are premature 
and ^ll^concelved because -the basic knowledge base is inadequate; the 
argime^t that applied work is ineffective in solving problems because it 
Is f^^ad in terms of existing conceptions that are inadequate and will 
remaii^fio mnttl basic research produces major breakthroughs that affect 
the way wa think about problems as well as the knowledge and technology we 
apply to them. However, other persuasive arguments can also be made for 

0 

applied research at the expense of basic research for example: the 

argument that we already know a great deal that is useful for solving 

^ pressing problems that cannot await maturation of the field's basic 
H-fcdwledge baper or that effective solutions can be developed if the 
available knowledge base is effectively transformed and structured in 
a mannar that facilitates application- 
Work now in progress will soon provide-us with a better picture of how 
much support cbmes^^from which federal agencies (and other sources) for 
basic and applied research (e.g.: analyses currently being conducted 
^by staff members of NIE's R(ScD System Support Division) and will place . 
us in n better pofrri tion to" make judgments ^f the adequacy of the level 
of founding for system development. Numerous criticisms liave hceni made 
of ba'sic research funding la particular --that \t has been relatively 
small in scale (and overwhelmed by proposals relative to available . 
funds); lias not f^een designed in .iccord with any overall basic research 

' strategy; and has lacked either continuity ov high visibility. 

'rhere were mniiy lilgh ht;]>es ior NLK in cohncction with basic research in the 

:i7B . ; 
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months prior to Its creation — but NIE has not become the*thlnk tarjk of 
eminent scholari that NIE' proponents envisioned and argued or, Insteadp 
funding probiems have forced cutbacks in the small basic studies unit within 
IJIE; allocations for basic research grants have reTnained relatively small; 
and earlier initiatives to strengthen basic research (e, g,: the four«yaar 
funding of COBRE, th^ Co^ittee on Basic Research. in Education) have not 
been continued. * r - ^ 

The COBRE project was of particular Importance. It had an eminent organiza- 
tional setting (the National Academy of Education and ^t he National Academy . 
of Sciences National Research GQuncil) . Eminent scholars served on the ^ 
Committee. Its task was "to Identify problems to be attacked by basic 
research in education and to d'evelop and try out plans and procedurea for 
stimulating and supporting such research*-' It had moderate success in 

attracting both established" and younger scholars from the social sciences, 

\_ ^ J ^ ^ J J (12 J 20, 44) 

to basic research in education. Still , it was discontinued * 

G* Ethical Issues 



Ethical issues surrounding reiationshlps between researchers and human 
subjects take on added meaning in education where ^he human subjects 
are often children and where relationships between researchers and 
practitioners'^^^e often strained. In educational research settings^ the 
^^ed=^vo=^0te^#-su¥4-Qot-s==fcom 4iatefu4-iai-f^at^3--©^--eKper4jre^ ±xB^ment3^., 
or from invasion of their privacy is a' very important issue. These 
direct ethical issues raise further issues about the amount of control 
a researcher can^have over the conduct of his own inquiry =^ e,g,: the 
role of the practitioner in defining the prdblem to be investigated; the 
amount of manipulation of "treatments" to be permitted in an operational 
field setting; the needs q% researchers for i stable pfrogram stimulus 
vs. the needs of program personnel to keep changing their program in 
terms of changing needs and understandings of .what they are doing. 

The Changing Character of the Educationalj Research ConpnUnity , 

A. Inlt_iall^'_ A University Base f ^ 

j^n addition to these various rep^^^pL issues, there are a host of new 
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issues that have eme.rged out of the changing character o£ the educational 
research enterprise. Until the mid- '60a educational research was an^/ 
activity carried out by a relatively small number of individual researchers 
^o were based in the universities j operated with a great deal of autonomy 
in defining problems and' conducting investigations; devoted a small 
proportion of their time to research; were oriented primarily to 
publishing research findings that might add to our understanding and 
knowledge about educational phenomena; and were regulated primarily 
by a peer group review system that allocated rewards primarily In the 
form- of prestige and recognition within the scientific community. 



B# New Institutional Arrangements 

Developments of the past decade and a half have transformed educational 

research. The educational research comunlty has grown rapidly In numbers 

C88 93) 

and in diversified Institutional bases. * Although almost all basic 

research is still car,rled out in the universities and some applied work 

is done there as well^ non-profit and for-^profit research corporationa 

have, emerged as a strong competitive force In securing applied resea^h' 

contracts from governmental aganclA*^^* Consequently, more and 

more of this research is being done outside ^the universities, with serious 

consequences for research training; for information flow and the cumu-- 

' 1 a t Ive "3 e vf IVpmenfc' ^^oT" the ^ FleTd ^ s Tcrto wTeH g ^'^ff t e eft n 61 6^ '^"a ¥ e ; " "and 

for the manner in which (and the extetit to wl^h), research findings get 

to be disseminate^ and utiilEed*^ The new institutional,"arrangements for 

the conduct of research have turned research Into a full-timf pursuit for 

a large portion of the research community. Of even greater conse^j^nce , 

these new arrangements have had a significant impact on ^ the nature of 

educational research and the educational research conmunity. These new 

arrangements have produced new patterns of rgsearch functioning (e,g* 

research teams rather than individual researchers)* There are new modes 

of researoh management and new constraints on researchers ~ l*e*^ 

bureaucratic s mission-ofianted research management that limits the 

individual researcher *s autonomy in both definirfg research problems and 

' C25) 

conducting inquiries. There are new research subcultures with wholly 

new systems of rewards and controls that 47eak£n the 'impact of the disci^ 
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pllnes on the conduct of inquiry — e.g. i political and bureaucratic 
norms are competing with and (for many) replacing professidnal norms | 
political influence and economic incentives are. replacing scientific 
recognition as rewards | and agency acceptance and utilization of research 

findings are replacing peer review of scieiltlfic quality as^he dominant 

, , (28) 

controls* 



Cp New Kinds of Accountability^ Is aues 

The new prominence of educational reaearchs and ffi^-amount of public funds 

flowing to it 5 have posed new kinds of accountability Issues that may be 

harder for ceaearchers in the education sector to resolve than researchers 

in other sectors which have stronger Imowledge and technology bases* The 

Congress has been demanding public accountability for an Immediate payoff fron 

its investment in educational research ^-^ without any realistic apprecia^ 

tipn of the eKtended time frame needed to produce results in research in 

general and in educational research In particular* Thus, we find a 

"Catch » 22-' type of situation* On the one handj to obtain funding j 

researchers must prbvide some promise of a payoff regardless of the 

fact that research by definition involves ^a not insignificant degree of 

uncertainty* On the other hand^ to make promises which cannot be fulfilled 

,-■ ■ i » 

may result in the researcher being funded but even more i^pprtantlys 

^sucK unfulfirTed pFdm^^ an^"^ " 

a worsening of the political environment of the research enterprise* The 

proper stance for educational researchers to take in relation to government 

agencies^ and the kinds of research outputs they should provide (i,e*: 

solutions J approachea to defining problems and thinking about solutions ^ 

or information about the likely or obtained effects of alternative solutions 

under consMeration by .;policymakers) — these are matters of serious debate 

7 ' . (22 79 110) 

among edudptlonal researchers and social scientists in .general. 

The Future = • 



Despite frequent calls in recent years for, a strengthening^ of the educational ^ 
research community and more field-abased initiatives to structure the national 
reseirch agenda for .education, " the educational research community remains 
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diffuse fpolltically weak, and largaly raactlve to federal Initiativas daslgnad 
by govarmnant bureaucrats who ara ganarally not members of the rasaarch com-* 
munlty* We see relatively little evidence that this situation will change in 
<the near future — feertainly not without Nil support and initiatives* 

The strengthening of the edXicational research comunity in the future may 
well depend on collaboration among the leadership of the research coTOunity 
and the key federal agencies and other major sponsors of educational research, 
with initiative perhaps remaining still with the federal agencies* Our 
analysis of what is needed is based on coreideration of the somewhat distinc^ 
tive requirements of basic and applied research and the current state of 
development of the institutional and personnel bases for conduction of the 
basic and applied research functions* 

In thinking abput the future of educational research , we will need to review 
our understanding of the basis upon which it may be assessed and of its current 
status. From these we may suggest key needs for the future development of the 
educational research function. We will do this, separately for basic and 
applied research. * 

A* Basic Research - ■- * 



"As s e s amen t ^asi s " 



In assessing basic research for education, it is importarit to recall the 
Interdisciplinary nature of educational research. On the one hands, 
said that there is basic research being performed in several disciplines 
Ce*Jpft peychologyy sociology) which' will be r elevant to education. 
However, education is a subsidiary concern of these other disciplines. On 
the other handi consideration has also been given to basic research which 
is done within the f_l_ej,^ of education per se and which is performed by 
researchers trained in and committed primarily to education as a field 
of study. It is this^atter focus which ii our primary concern here 
because' of the importance of^having a basic research function whose 
primary and ongoing focus and coiimitment is on the field of education per 
se ~ while at the same time racognlzing and ucilizing important and 
relevant basic research in other* field^. g g 



km basic research is an uncertain, unpredictable and highly creative uncer 
takings it Is very sensitive to threats to its climate and to the quality 
and atabillty of support and funding and is highly dependent on its roots 
in its fundamental disciplines. Its outputs are knowledge and stimulation 
and it is only generally in the long term that we can assess its practical 
contribution. And, given its inherent uncertainties it becomes hazardous 
to attempt to predict the areas in which such outcomes will occur. But 
without it the well of new thinking frequently runs dry* It is therefore 
vital that a healthy and mature R/D&I system will have developed and main- 
tained a substantial high quality basic research components 

Such a component cannot be built quickly. The rate at which quality 
basic research can be expanded is limited by the size and quality of its 
existing centers of excellence (which may range front a single outstanding 
researcher to a team of such researchers) * To pump more funding into this 
endeavor than such centers can usefully absorb ^n only lead to waste and 
disappointment. Future growth is (a^ will be) limited by past invest^ 
ments in creating and supporting a central core of basic research having 
many centers of excellence • The major problem of basic research within 
education as a field of study per se has been as we noted in the very 
weakness of this central core. 

Assessment o^f the basic research function will need then to be based on^ 

1. The si^e and quality (based on the reputation of institutions and 
personnel) of the central core of the basic research function most 
specifically on the sizes growth and stability patterns of identified 
centers of excellence* An important indicator will be the ability to 
attract and hold top flight researchers. ^ 

2. The number of new centers of excellence seeded and taking root over 
successive (rolling) 3-5 year periods* 

3. A measure of the supportiveness of the climate - in terms of funding 
growth and stability over several year periods. 
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4. Measures of the quality of the linkage to and reputation of basic 

research lh*educatlon and Its more fundamental root disciplines (e.g.; 
psychology, sociology, ate.)* ^ 

5. Over long (10-20 year) time spais, an aBseasment of major substantive 
contributions to knowledge coming from educational basic research. 

Current Status . ' 

We have seen that basic research in education is generally to be found in 
two types of settings. That located in aqhools of education (frequently 
in such disciplines as^educatlonal psychology and sociology) boasts few 
centers of eKcellance and much mediocrity* A different picture emerged 
frg^viewing the research carried on in discipline based university depart 
ments such as psychology and sociology. Excellence and valuable con^ 
trlbutlons to knowledge are to be found, but what has been lacking here 
has been a primary and continuous Gommitment to education. The intern- 
disciplinary character of educational research has added to the diffuse- 
ness by making communications and information retrieval (from the large 
variety, of publication sources) very difficult. Altogether, this has 
added up to an educational basic rasearch community that has been to 
data unstarble and amorphous. It makes system building in this area a 

J or ^ re q u Ir emBrrr ^ End " ^ CT Irt c ^xun s id er a=t lon= =± f uiKli-n=g="pr o-g r ems % = - - ^ 

At the same time j the general climaoe for basic research in education 
as for other (especially social) areas of basic research has been far * 
from supportiva* This negative climate has been particularly Intense 
for education which has been hard put to point to more than a handful 
of significant devalopments chat are tracaable to basic rasearch* Tha 
low prestige with tJhe general public and with Congress and the associated 
unreliable funding have made it hard to attract strong talent and this' 
has acted as a major constraint on building the central core* As 'regards 
funding, it is vital to note that thera are many agencies which fund 
basic research in education* Indeed, tha National , Institute of Education 
(which has been assigned "lead" responsibility for educational research 
and development) has be^ a relatively minor contributor to the total 
funding going to basic research, especially in comparison with such an 
agency as NIH, - ^ , ' * 
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Key Needs 



In light of 'the above surranary analysis of the distinctive requirements 
of basic research and the currant state of development of this function 
in educatiDnj the key need would seem to be for a consistent, continuous, 
stable process of system building. This would include: 

1* identifying axisting centers of eKcellencei 

\ . ; . - ^ ' . 

2, facilitating the e^J^bliahment of additional centers of excellence; 

3, facilitating the growth of these centers , existing and new; 

4* facilitating improved iifformation exchange and retrieval mechanisms; 
5* providing ^table* long term funding, 
B'_ Applied Research 

* 

Assessment Bigi^s 

It Is important to be reminded that applied rese£^i;ch Is research and shares 
with basic research a high level of uncertainty and unpredictability* ThuSj 
researchers in particular treat applied research In a basic research mode . 
But it is also targetted research* Thus, funders and users often assume 
it to have the level of certainty and shortness of time line more appropri- 
ately associated with development. This deceptiveness and the consequent 
inherent tension makes applied research subject to considerable Instability, 
misdiraction and mismanagement , and consequent misdirected assessment. 

Researchers frequently redefine and bend applied research into bas-ic 
research modes* , In "particular , they often attempt to i^dertake projects 
on smaller scales than are required by the nature of the problem_s, which 
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often require the efforts of large-scale intardlsclplinary and ampirlcally 
baaed team programs* This syndrome Is often combinad with atteripts to 
oversall the timings probability and impact of outcomes in order to obtain 
funding. This often succeeds with funders simply baMuse applied resaarch 
^^^jitoj acts do appear to have practical s attainabia outcomes. All of this: 
creates an environment that tends to ^a unattractive to many of ^the baat 
researchers * 

On the other side, usars and funders, having been fcersuaded to fund such' 
programs because of these very eKpectations of near^^rme benefits, become 
frustrated by not only the lack of dalivery but also by the shifting 
targets, time and cost patterns which are inherent in the uncertain research 
process* . 

41 ' • ■ ' ' 

Another important dimenaibn of this tension lies in the problem of need 
Identification* On the one hand^ the objective is to work on important 
and timely problems that require solution, and this tends to be the prime 
inducement for the users and funders. On the other hand, a researcher is 
required to maintain the criteria of researchability criteria that 

often significantly limit the utility of the project from, the user per^ 
spective* This as well as the previously mentioned problems of tension 
become magnified when one recognizes that the cbst and scale of applied 
research tend to run orders of magnitude higher^' than what is typical of 
basic research," 

Assessment must therefore be based on judgments of: 

1p The quality and appropriateness of the institutions performing this 
function: j 

, Are they capable of mounting the required large seale intar-^ 
disciplinary efforts? 
Are they attracting and keeping top quality applied researchers? 
Are their programs and projects considered to be of high quality, 
important to practice and on truly reseErchable problems? 

2. ^Whether applied research is emerging as a definable entity ^ diffe-r^en= 
tiated from basic research and development- 
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After a time lag that reflects sayeral years ©f sustained system 
building, an evaluation of the rate and impact of outputs* 



The climate for applied research in terms of both support patterns 



and receptivity to its outputs. 
Current Status 



Most of the research that is carried on in education appears to be what 
might loosely be defined as the applied type, much of it unfunded and 
small-scale. The volume of studies produced may indeed by large — but 
being of this small-^scales scattered and fragmented quality, these have 
been subject to many questions of quality. It is evident (as mentioned 
earlier) that there is substantial lack of differentiation in education 
between what can truly be classified as research and various ather acti- 
vities (e.g.: demonstration projects j social bookkeeping, etc.); great 
weakness in defining researchable problems; considerable fu^^iness in 
differentiating applied research from basic research and development; and 
the previously mentioned tendency to oversell such pr oj ects .^^ ^ 

As we noted earlier, applied research in education is largely carried 
on in two types of institutional settings^ universities and large-scale 
MD institutions in the private and quasi-public sectors* 

Where this work has gone on in universities, there has been a tendency 
to perform applied research in a basic research mode. tsThls is not sur- 
prising given the socialisation and prior training of university researchers 
and the social atid publication pressures under which they operate. Generally, 
universities find it difficult to assemble the minimum critical mass of 
effort needed to undertake large-scale applied research projects. As : , 
a consequence, they have.. tended to scale such proj eats down and/or to 
assemble ad hoc teams that lack long-range stability. With this has come 
the unfortunate tendency for researchers to move in and out' of this part 
of the field which has mitigated against system^building^ requirements , 
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Large scale R&D organizations should have been, and to some degraa have 
bgen, more auitabla sites for such progranis. However ^ two Important , 
problems have limited their potential success. Firstly, most of these ^ - 
R&D organizations have not been able to promise a stable career path to 
researchers j thereby greatly limiting their ability to attract and hold 
first-rate researchers* Secondly , federal funding practiced in the late 
"60s shifted the character of many of these Institutions away from applied 
research and reshaped them into development organisations in accord with 
federal priorities at that time for product^centered impact strategies* 

As a consequence of the above conditions , educlation has in fact seen very 
. little applied research. Therefore, this has to be seen as an area that 
needs to be put together at this time in its own terms and not be thought 
of as a form of advanced development or downstream basic research, 

A number of other problems in educational applied research were previously 
implied but require further explication. The climate for such research 
has been perhaps even more negative than that described above for basic 
research. This has been so praclsely because it seemed to hold out more 

1^ promise of Impact and raised expectations than could have been satisfied 
~ given the inherent time frame and the weak state of the area, Relatedly 

^" neeff r iffin t if icat i6n7 wh ich ^ had \¥ien r e liar char- tff"f van "up ^^fihr bugh^^t"he 'mi3^^^^ ^ ■ " 
'SOs, became system-drlyeii/by users and funders in an overraaction to 
this state of af fairs , f-rAs with basic research, funding has bean raaltively 
limited. , ' ^\ > 




Needs 



Applied research in education, then, must be seen in a system-^building 




1. It will be essential to locate those centers of exeellanca capable 



of performing laTge-scala applied research . 
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2, Such institutions will need to be provided with the kind of long- 
term stable funding that will permit them to attract and retain 
top-'f light staffs of researchers, "* : 

3, It will also ba vital for the lead educational funding Aganciea to 
help practitioners and the Congress understand theriature and re- 
quirements of applied research tou 



understand that project selection requires the determination 
of what is researchable as well as what is important; 

recognize that the present lack of capacity demands a period 
of institution'-bullding before the promise of the area can 
begin to be fulfilled; 

and understand that such institution-building will require an 
ongoing and long-term conmaitment. *. 



As described in the literature ^ the deveij©pment function in education adheres 



developmant mode as it is carried out in pursuance of governmant contracts ^ 
primarily in regional laboratories and in some of the non-profit and 
for-profit rasearch and Rfi^D corporations* If we accept a' broader and less 
rigorous definition of developmant work^ then we must also include several 
oth^r models of the development function as this is carried out by class- 
room teachers 5 by curriculum specialists in SEASj ISAs and LEAs , by textbook 
publisherSj and , in univeraity-based curriculum projeGts, 
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1. Development as an Institutionalized Functional Specialty. (Using the 
RjgorQus Devej-Opment Model) 

jGons^arlng first the rigorous definition of the davelopment function as an * 
InstltutionaliEed specialty that is carried! out by ^eciallzed personnel 
in apaciallzed institutions or organizational units, develqpment activities 
are systeinatic and sequential. Development moves in a smooth progression 
from prototype design that Is'^the end product.of the applied research pl^pse 
of R/D&I; to product or program developmeht in accordance with detailed 

specifications; to evaluation of small field tests; to revisions; to 

^' ^ _ . . . _ _ _ 

larger field tests; to more revisions; to an addttlonal field test; etc. 

until the product performs in accord with the prespecified performance ob- 
jectives* Products go through successive generations of revisions ^ each a 
closer and closer approxtmatlon to the performance specifications. Revi- 
sions are based on empirical field test data that are gathered systematically 
and analyzed rigorously. The evaluation data provide the potential user 

with precise Information about the outcome or effects to be expected from 

" (60) 
use of the product under specified Implementation conditions* 

Development projects implemented in accord with this mod^el tend to be large*^ 
scale and expensive; involve large personnel base pools and heterogenous 
skill mixes*; and involve extensive cooperation between the R&D organizations 
^^d"€v e 1 op iTTg- ' tta '^T Q du trt-g- mnd^^ tti e - a e h&o 1 - -s-y^tems - a g r e e4 n g - ^q--^bv^^ - as- i^^l d 
test sites* The products themselves are often complex^ consisting of many 
and varied modules or component^, and often several forms of media as well 
as printed materials; The management of these complex development projects 

is often highly Jormaltzed, using flow charts and sophisticated management 

^ ^ (60, 66, 116) ' ^ ^ 

tools * y 

There may be some variation^ in pattern depending oti the nature of the R&D 
outcome being developed e*g**: products vs , change processes. However , 

the issues of concern to managers tend to-be consistent: How much research 
is needed prior to the development work? How much re.sear^^; 

parallel to the development wprk? At what point is the p^^fc^^^^Kl,cient ly 
developed to permit initial field testing? At what poinri^^^^^^^^rcoduct s ^ 
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been taaCed sufficiently tu permit disseminatiorL? ^ What dissemination^ "mt^r- 
ketingj and implementation factors need, to be considered throughout the' 
design and development phase? At what point does the responsibility of the 
developer end* development? disseminat^ion? installation? utilization 
and^ maintenance? , 

2. Development in the Education Sector - * - " ^ ■ 

These issues are to some extent connnon to the development function in all 

sectors s but they take on particular significance In the aducation sector. 

The weakness of the knowledge and technology *base of the field makes it more 

difficult to translate performance specifications into effective produets* 

Outcomes are far less predictable given the reactiveness of the user satti^ng 

and limited technical capability of user personnel to implement complex 

innovations without substantial implem^tation supports. Consequently, 

development work in education requires a far greater Investment of time 

and money in the research and evaluation components of the development - 

process, making development costs high relative to practical payoffs 

■ * 

a problem of particular importance considering the negative political 
climate in which educational R&eD appropriations are made. 

The rigorous ' model of the development function as it is used in the regional 
laboratories can be contrasted to the more tradttional approaphes to the 
design and development of instructional strategies and materials =^ as 
these activities have been carried. out by classroom teachers; by curriculum 
specialists in the SEASs LEAs, and the universities; by publishers; and by 
the university scholars who have on occasion participated in efforts to 
improve K-12 level curricula and instruct ional materials in their areas of 
Specialisation, ^ ^ 

The development approach used in these settings tends to be intuitive rather 
than data--based or grounded in theory* The focus of attention is generally 
on the content to be conveyed rather than conception of how- students learn 
or how teachers go about providing instruction. Field testing iSj non» h 
eKistent or minimal. Devel^opment ^osts are relatively low. The personnel 
involved 'are relatively %ew (e.g,^ teacher, a few> scholars or curriculum 
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specialists 5 ate,); and whatever skill mixes are present In a development 
team tend to be re latively^ homogenous Management is generally Informal 
and highly flexible,***^ Where textbooks or materials packages are being 
developed for large-^scales nationwide dissemination, an effort is usually 
made to in|^ude Implementation supports' iiv the jEorm of teachers' guides, 
testSi etc* ^Where materials are devel6ped"jlocally^ f or use'^by a single 
teacher or a group of teachers it^ a single school or district^ far less 
of the implementation process is commitie# to print or m^dia .presentation; 
the state of "development'* of the materials or strategies for use outside this 
small group remains inadequate; and either the locally developed innovations 
are not disseminated at all or they are disseminated but. have minimal success 
elsewhere because development work Was not carried far enough to permit the 
materiala to be implemented easily and effectively by others. 



3, changing Fatt:erns of Federal Support £or Educational Development 

The rigorous development model is likely to permit more effective implementation 
o|^ developed product s * However^ consideration must also be given" to the high, 
costs of rigorous development work^ the relatively limited utlliz^ation of 
eKternal^y developed R&D products to datGj and the extensive amount of local 
innovation that exists. Thus 5 federal policymakers ,are giving increasing 
attentiort to. internal user system development .resources build^ig internal 

^inoo va^J^n^-£: apiibilit iQa4^-... -li^ak iiig^.i^XeE.aa.l--^.aLU^cas^^f- =4nn^vationx. t-f^., 42xtG£naL^..-^.^=^ 
resources for document ing "and analyzings .local innovaLlons'^nd developing * 



materials that could be used to assist other 'school systems in implera^^ting ^ 
these locally developed jrograma and practi^ces (e.g^: OE programs in support 
of SEA effo^'ts to identify, validate, and package exemplary practices; NIE^ 
supported programs to build SEA dissemination capabilities and LEA problGm 
solving capabilities). The buj.k of federal development resources appear still 
to be awarded to^extarnal R&D organizations that use the engineering model* 
(We will'be in a better position to verify this impi^ession after data *'from * 
NIE ' s current survey of KPU organizations are gathered and arfalyze^^) However 5 
It seems possibletr that this balance may change in time, If this does happen," 
the character of the development fiinction (as tlws...is general ly unders tood in . 
*the education^ R/ I^'r comm.uni ty ) may undergo considerable changej and with it 
^ the 'ins ti tut ional bases, ^the personnel base, and especially the teclinology ^. 
of the development funct,i1^n* • , ^ 
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' 4. The FtiCu^e ^ 

■ 1 — ~ I I * , f 

If the 'development f^netlon In education were mature, we would expect tq 

^ find a latge supplj^of high quali.ty outputs "that are r'espotfeive to user 

needs. S^nce-most available outputs of educational development appear to _ ' 

be weak inioth quality and resppnslyenees, future strategies for sttength- 

' ening this fimctlon must be based on conslderattpn of ^the essential ?equice= 
' . ' ' ' \ . f \ ' . * ^ * ' * 

.nents ©f the the major weatoesses of each ^of the 

two predominant modej of development work "in the education field* 

As we noted in the discussion of the future of educational research, to 
think aboufiNvthe future of the development function in educations we will need 
to revl^w^-Wi;^ understanding of the basis upon which the educational develop- 
ment , function may be assessed and of its current state* From these we may 
suggest key needs for the future of the development function in «ducatidtt. 

Assessment Basis 



As we have noted critiMl in the a&sessment of the developmemt component of 
an R/D^I system is the recognition of the cen^rality of its t^irirages to 
the user, to"^ production and t6 the state of art in development. Development 
has a relatively more predictably and shorter time horizon proaess as com- 
pared to the research functions* It aims to convert knowledge into user- 
read^ products, products which may (or may not) need to pass through a 
distinct production pfiase before tfiey can h0 disseminated or distribute^* 
With the linkage to the "user beii^ so critical, so is the requirement for 
need identification a step that is difficult to perform, but one that 

must be done ^'we 11 and often in an ongoing manner during the development 
process (whe^pia complete identification is hot feasible - ~ as in many 
areas of social development) if the product selected for development is to 
be on target • . ■ . ' 



Development is also highly dependent on the quality pf^ its linkage to tha 
state of the art and on the skills and motivation with which products are 

r 

designed so as to be capable of production and dissemination* This deters 

i I ' ' . 

mines Che .ef fectivejiess and viability^ of the product. 
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Slne^ d^aiopmaiit Is frequently carried out In specialised davelppm^t 
;C»^gulsation3 It is ^Ighly dependent on the quality of sueh Institutions^ 

V a&tf tbelr personnel and most partleularly on their es^erienae, is 
li^ortiait to differentiate the concept of exeellenee In developTOnt from 
that' used in rjiseareh. In develo^snt excellence is measured by being 
cost/effective^ tlAely and opportunistic* With such criteria, pKperience 

i^C^sdlvldual and orgmlEatlonal) and thorouglmess (ability to do: the whole 



are qftw niare l^ortant thm brilliance. Where developpent is carriedi 
out in a user setting , then assessment must be concen^pd wi;ta the utent ^ ^ 
of wider dissemination of the products or processes developed. 



Thuf^, the critical bases for aaaessment are I 

-A ^ ' ^ ^ • ' 

1. Quality of linkages toi 

// ^ users 

= >: - production 

; - develo|3ment state of the art. 

Measures of such linkages are hard to define and obtain, depending 
as they do upon quality, frequency and £ ortn^ of interactlQn* They 




will likely be qualitative in nature,/ and "bbe^rvable" more in 
their absence int terms of probleins generated , than in their 
presence* 



A specific manifestation of linkage will be in the quality 

* of need id^tif ication, to b4sffleasured indirectly by the rela- 
vane e^ of development ^outputs .for practice, and by the scope and 
'effectiveness of feedforward activity frdm usera to devalopets* 



ERIC 



^^umber and ef f ectivenes^""rf large-scale development organisa- 
tions* Effectiveness here would iibe measurable in terms o^ 
extent of adopted products , and some qualita'ilve assessment 
of ^impact ' (actual and potmtial) . 
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!• EHtent of dissemination of pnractlbe-based davelopments • 



4. nmttber and quality of products developed from the whole 

; V R/DSI system and their Overall; Cportf olio) effect , Quality 

would again have to be maasured by usage based criteria #^though 
the locus of quality control would ba a design variable* . 



Current Status 



^ we have discussed , /aducational davalopment is plagued by a weak 
taowledge base. The quality: of information is poors very little has 
been codified. ' As such, quality control is a ceritral requirement , Vhich 
has .only racently begun to raceiva serious attention but whith is a till 
relatively poorly developed and its enforeemint a matter of some dif «^ 
fuseness as to Ibcui of responsibility. With limited ability to depend s 
on quality control/in the fields funders and progrM managers may need ' 
to build quality control checkpoints into staged development procurements 
a procedure that demands closer involyement and orchestration between 

key funding agencies and the field than has been typical to date- 

' - ^ . ■ . '- ' ■ " 

We noted earlier that "th^re are two distinctive modes of development 



work in education i 



development work that adheres to the rigorous development model 
and tends to go on in specialised development organizations ; 



b, more conventional s Intuitive modes of developmerit that tend 
to be carried on as part-time activities in practicfe-based 
^ settings * > ' ■ 



^t its best specialised development organizations represent a strong 
element in educational R5fD system capacity. There are a few* such well 
Staffed and experienced developmfet orgahizations and their existence 
is an important indicator of. the system building that has gone on* More 



of ten, however , the' institutions and personnel involved In development 
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n«t coma up to these required standacds. Ivan the best %l these 
^rganlzatlpni, tend to suffer froi isolation .from practice, makkng dis- 
^semlnatlon and Impleaentation problematlcai. This may be bne of the 
.eausps of' the limited utilization, of R&D based productB, a ■hortcomlni 
that is 'tending to' threaten the. Viability of this type" of iristttution. 
Thire be a critical need In development net to increase the 'level , 
of effort overaill (there Is an inventory of mor^ than half 'a .million R&D 
products tftat are .available for sorting, .tailor Ing, papkaging and dl's- 
stmlnatlon) but rather for' a shift of emphasis so as to build up more 
of the strong high quality development organizations with whom the gov- 
er™ent can contract and to ensure their closer linkage to practice. 

The second basic mode of development in education (practlce-bas'ed) does 
i^ot suffer (obviously) from poor linkage to the user, 'it does suffer, 
however, from Inefficiency, lack of sophisticated skills, poor documen- 
tatlgn of its achie;^ements , difficulties with packaging-^ and from 
^enormous problems in achieving wider dissemination and diffusion. Statfe 
initiatives have become particuiarly significant in recent years in 
Identifying, packaging and dlsseminat.irig exfemplary practices and'progrMs 
developed by local phhool systems. The verdict is not In as to whether ' 
this mode can become a source for wider application " (beyond the local 
development site). Meanwhile, further Research on this mode Is required 
as well as support.- for efforts to supplement and eipand local capabilities 
possibly through increased linkage and coilaboratlon between practice 
based davelopment and sptcializad davelopment organizations. 

In the araa of ^project aalaction the amphasis to date has bean on a 
project-by-=proJact selection procass. Missing haa baen the capacity in 
the system to consider critical portfolio. effects , . These could Involve 

.decisions to target and concentraee|davelopmant programs, so as to achieve 
synergistic benefits, staging and alquencing .strategies that minimize user 

disruption and uncertainty , cooperaM^ ventures across agencies, etc. 

Particularly Important may be the n^d to develop skills in commercially 

nation so as to make better decision^ with respect to what to place with 

which elements of the private .sector 'knd when. 
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KfvKeeds ^ 

- ■ ■ — ^ • _ . ^ -•. . > . _ — . ■ • - ■ 

With the above in mind* the follbwlng would appear to be key needs for 
the educational development ^functions partlcularry with reference to 
the '^ole of key funding agencies. * 

. ^-^ ^ .... • ' . , ' ^ . ^ ^; . ^ - . \ ' 

li Wjork with the field to build up the explicit desi^ing-in of 
' quality control ^functions into funded^ development programs.^ 

poasibly Including staged progrmis with quality control check 
'points. . ■ /■ ■■ ^ " ^ 

2, Shift support emphasis to favour fiiose high quality specialized 
■ development organizations that show a patt^im of being reapoh- 
aive to practice needs and to technical o^ortunity-, 

3* Work with SEAs and LEAs to determine the most cost effective 
rwayn of identifying and disseminating practice based develop- 
ment products*, 

4* Study and experiment with strategies designed to improve the 
interface between the govermnent funded development ©rgani= 
zatiqns and coBmercial firms ^ - including development of 
criteria for what should be handled how and by whom, ^ 

5, Development of program planning and project selection methods 
by key funding agencies that give explicit consideration to 
portfolio effects . 

6, Explicit programs designed to achieve Inter-agency cooperatiori 
for development activities, 

7, Study and experimentation with strategies designed to improve." 
the interface between. the government funded development organl- 

zatldns and commercial firms - Including development of 

^/ 

/ criteria for what should be handled how and by whom. 



pMductlon Issups are of minimal concara this point in the historical \ 
devalopmsiit ^?€he adueatlbnal R/DM syetam. As we use the termj the 
p'roductlifli^iunetion is restricted simply to the reproduction or mahufajturlng 
^ qiiai<t<fcy of a fully developad and^teitad item. All d^slffiij|id devalppment 
' wrM is subsumed under the research, devalopniant , and evaluation research ^ ^ 
lunetioni* For the moat part^ product ion in the education aeetor takes 
place in the subordlnata system df institutions that provide puppprt sarvleas ^ ' 
to the educational R/DM 'syttam publisharsj film productibn companies, 

** manufiacturars oi hardwara and equipmaatp etc* These product ton Instirtutlons 
- tand to be saetor-spanning In nature , and none^ of the production Issues- that 
come into play appear to be sactor-apeciflt to aducatton, ' . 

Production issue^.-^«re-of -X^^latlvely low priority in the education sector Th'a. 
overwheimiag^ majority o'f educational produGts and R/D&I^ outputs tand to be' 
softwara rather than hardwara; the predominant .jnedium Is print; and^ the ^ 
■ key Issues of performanea and reliability have "less to do with possible 
breakdowns In the production function than with weaknesses in the davalopment 
i function pr the Implementation process* CoimnatQial publishers generally 
^ strive for a. high Quality print product using costly matbrial^ and production* 
techniques* On the other handj the glosi of corranereial publications is 
generally absent from the outputs of R/D&I organizatibna , To some . ^ . 

significant degree , this^^apjears to be a consequence of clearly articulated 
policy decisions- of educational R/D&I sponsors and contractors^ Educational ^ 
.R/D&I decision iakers have opted consclbusiy for allocating maximal resources to 
/the rasearchj designj development , and evaluation of, the substance of the ; 
matertalss and the barest minimum to prodifction just enough to insure 

that a sufficient. quantity of usable materials c&n be distributed to 
operating s/s terns, " ^ , ^ 

Some recent initiatives have' been taken to devaLop collaborative relation- ^ 
ships between R/D&I organisations wiih strong development capabilities and 
conmercial ^publishers who can add ^high qual Ity production capabilltte| 
(e^.g.* arrangements between App4eton Century Crofts and the developers of 
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Individually' Prescribed 'Inatruction) . However , ^ these arrangements are relatively - 

; ' ■ ■ ' ^- ■ '198 . ^ . ' ; ■ - ^ 



few in humber; the 'linkagas, are tentativa and experimetttal ; and as yet tjrfe 
production function i^s barely visible In Qhe canfiguration'^f educatiopa] 

kIv. marctting/distoibution/Bissemim 

k • . * t 

' ^< 

The linkaga functions of "markating/distribution/dissemlnation/d * 
have always baa^ among the weakast. components of e^ducatlonal R/D6il,"and' 
iifcve only racently bacame the focus of fedaral arid state R/D&I prtlcias, . " . 
Each of, ^ these functions has had a numbar of .traditional meanings, aach 
with Its own sat of dnstltutionBp channelSj tod ch/ltacteriitic activities. 
New concaptions of these linkage functions are gaining wi^r acceptance> 
and nawf institutions^ channels / and' activities «ra , appearing to qperational- * 
ige^ the newer approaches. , . * ' 

1_* ^ An Empha sis _on In forma 1 1 on F 1 ow ' % . , „ ^ 

^ - -- " ' \ it' r ' ' ■ ' " '■ 

Until recently^ the dissemination function has been 'eoricerned^rlmarily with 
the flow of informacion ^- the outputs of rasaarch rather than the 

marketing and distrihution of packaged products, fu/ther^ dissemination 
strategies have been so passive and uncoordihated that the -burden of effort ; 
In retrieval was oh^the rasaarchers an4 pra'ctitionars saaking information. 
The characteristic channels have bean publications - tfepprts of research 
findings in technical repor^ts to sponsors or in scholarly journal articles 
targatted at the research community; or in non-technical form in articles 
appearing in the magazines and nawspapers read by^ practitioners and ^ 
laymen. Informal j interpersonal information exchanges took place at 
professional association meetings of r esearche:rs ^ a,i|d a^ other meetings of 
practitioners^ and at odcaslonal conferancess semlnarSj or workshops. The 
univarsitles and teacher-training institutions alqo perfdrmed a key role 
in passing on a field's knowledge base in^re -service ^training prograrns, 
or in updating knowledge' and skills through 'in-service traini'tig. For the' 
most parts however^ this pattern Involved dissemination of Individual 
pieces of information with a potential for application rather than 
packaged Information ip^^cts designed to produce changes in practica. 



\ Thf" S%€epti6As here vere^the publiihera and equlpmant manufactuf ere tdio ' - 
packagad Information or techno products Into iinnadl'ately ugable 

foms and had well developed marketing apd distribution operations to ^ 
gat thalr products into t^e hands of practitioners with a mlnlinum of 
affprt on the part of user system parsonnel. - 

2« -Dissemination in the '60sr The Impact of Federal Policies 

Fadaral R/D5il pollclee In the '60a added several new dimdnsions to the th^n 
* eKisting ^L6des of disseminatidni The crowhing glory of the infoMatlon 
diss^lnation policy was the massive ERIC system created by OE to acquire, 
store^ abstractly and provide, easy computerized retrieval of sources from 
the extensive fugitive literature of the educrtion sector, ERIC. also 
provided publications that announced acquisitions to the field and ; , 
tharefope was expected to make them more visible; indexed the Journal " " 
. literature "of the flpld as well as^ the fugitive literature stored in 
the ERIC collection; and provided aeverri hundred information analysis 
products that synthesized ^hformation in. selected topical areas* (Pro*- 
feaslonal assoclatlona di both researchers arid praatitioriers also became 
active In the ' 60s^ in producing targatted Information analysia products 
or synthesis of the available knowledge and technology base in specific 
research areas — e-g-. the National Education Association's What Research 
jays ^to the Teacher pamphlet series i two pditions of the Handbook on Research 
In Teaching ; \ and four editions of the annual Review of Research In 
Education ! 12©),^ However ERIC has been repeatedly criticized 

as geared largely to the needs of researchers rather than practltioner,s. ^ 
ifore recently ^ in response to practitioner needs, ERIC acquisition pr^rams 
have Ihcluded efforts focused on storage, and retrieval of curriculum 
jiackages and other development products (^*g,i product information packages). 
,Aa yet, ERiC appears to be used little by practitioners- 

The network of institutions created by the^ federal government in the '60s 
Included organizations charged with responsibility^ for acquiring and dis- 
seminating instructlonar^ materials in given areas (e*g*i The Instructional 
Materials Cen,tfers) and Organisations designed to demonstrate, and disseminate 
exemplary local practices (Che ESEA Title III demonstration 'centers) : Die- 
semination of the R&D outputs of 'the J.aboratories and centers was considered 
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'a majttif function of these organizations. Categorical programs (e*g, i 
ESEA' Title I, Upward Bounds programa for the handicapped ^ vocfttional^ * 
career education) hava always included dissemination components Addl- ^= 
"Jtlonallys various referral organizations (e.g*i the National Referral 
Center and Phi Delta'Kappa - s School' Research Information Service) and 

Other more actlvf and interactive approaches to disseplnatldn (e.g^ i 

' " . ^ (29 90 127)* 

> education Information centers with education extension a^nts ' . . J 

also began to appear, in the '60s. Still* d^esplte all these initiatives | 

the early '70e It seemed clear that the outputs of educational research' 

and R&D were ndt reaphihg the user system to any significant degree or 

. having* clearly visible impact on-Improving educational practice* 



3, Federai Dlsserolnatlon Programs ' / 

^Current federal di^Wemination pfbgranis haye been built on many of the In- 
itiatives of the *60Ss but carry them further and change the focus of federal 
dissemination strateiies. Historically, the'overall federal .strategy could 

be characjterlzed .as : . , ^ ^ \ 

' C 1 1 2 ) ' I 

* 1, Initially one of laissea-f aire - (prior to the mid-'60a aftd In > 

the initial conception of ERIC as a passive information repository);- 

r ■ . - ^ - ^ ; ' I ■ ^ ■ - ^ . ■ ' 

2, then a strategy of product advocacy (the Instructional Materials 
: ^ \0 ~ J ~ 

Centers, laboratories and centers , and Title III demonstration centers 

* ■ V advqcating the use of particular products or programs they selected 
or developed) I - / ^ 

3, ^n^d finally^ strategies ^of ' ^ 

f ' . . ■ ' . 

a* coordination of existing discrete efforts, ^^^^ and 



(ll2) 

change^ process advocacy ^ ^ replacing advocacy of particular 

programs and prodi^ta with Informational and capability building' 
approaches: providing extensive amounts of (an^ easy access to) 
information on the full array of available products ^ programs ,j 
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and practlees to meat given, iieada ; pyovld(ing 'pas y 4c^€si^ to 
education extension agents In loctfl education InfpMiatiQn 
centers! developing users |, capability for devaluating^ adapting 
and implementing the products o£ their cheiee, 



" ■ . ^ . .. . . - ... 



THb federal role is seen as one of faeilitating], coordinating^ and providing 

/start-up funds to mobilize state and local dissemination resourdes.^ The 

focus la on building ^netwD^ks that bring; together and stren|then the dissemina- 

^^^^ ^^MOttrces of existing organlzatidns , that carry out disseminat^on^activltless 
eapaeially the SEAs. 5®^^ ^ \ 



The approaehes that .na^e been funded tend to be actilve and* interpersonal ^ ^ / 

e*g,i . working through educationaL-iKtenslan agents ^ local education informa- 

tlon center!, ^networks of fConsultants , and interactive ^on^uterlzed retrieval 

mechanisms. Educational extansion agents and other personnel working in, local 

districts are linked to ^centralized resources 'and specplalists| information 

needs of local users are determined; information and materials required to meet 

these needs are t^i^ansf ormed Into packages ti^ilored to the user*s heeds and cpn- 

S'traints; and followup supports and* feedback mechanisms are built into- the over- 

(29, 127) * ; 1^ ' \ \i 

all design. ' To date, these systems liave^een developed eKtens/ively in 

relatively few states, though the number and scope of these programs am ^expand- 
ing under NIE dissemination capacity building grants to states. Clearly, this 
ictive\, interpersonal, user-orientei and field-abased networking strategy is the 
ilirection in which educational dissemination In the U,S, 1^ moving -at this time, 

K The Current State oC^Dl^geminatlon 

, # 

clearly, the Instltutidnal base of the dissemination function has undersone 
5Xtensiv# development in recent years. Considerably more expansion. Is l/ffitely 
.f NIE*s Research and De-gelopment EKchange program (currently in the planning^ 
tages) becomes operational. Nonetheless, it will be some time before can 
Kpect to find substantial impact ^in the form of widespr4ad Improvement ^ /i 
ducational practice. TKere have been serious ef forts ■ to;i'>synthesiEe the 
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theoretldal kaowledge ba&6 of the fimctlon ? * but the translation *of 
this Imewladfre, base Into udable Btrattglae with known eifects le^ only begin-' 
alng. The disseminatioti specialty is o^ly now beginning to appear and Is tlaarly 
Inadaquate for the sctfpe of existing programa such as the Research and Devel-- 
opment EKchaxige progrffin noted above* Host of those currently carrying out 
dissemiiiation activities appear tb be practltioneri' by training* 3^ey are 
procseding intuitively •and learning the dissemination field on the Job* Few 
progruis arft available to train disaeminatidn specialists* 

Until recently, the linkage functions o#Naarketing/dlstributlon/dissem±na- 
tion/dif fusion have been among the critical ' gaps in the educational R/D&I ^ 
structure. There ai^ hopeful signs that dissemination* and diffusion ' 
are maturing. But despite all the discuaiion in recent yearsof bringing . 
.a. marketing approach to education^ ^^.'^^^ and ^despite tha current focus on upar ' - 
needs and usaf viewpoints , ■ - the marketing parspective is almost 

totally absent and may In fact have been buried altogether by the change in 
strategy fro'm product advocacy to change p!rocess advocacy * A dlstribut^lon 
system for other than coriventional conmercial products Is al^p lacking. The 
manner in which the enlarging dissemination netwofck may become (or 
become dlnked to) a distribution system is rtlll unclear. ^ ^ 
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The Future . . 

At the present point in time, the linkage, functtons of market Ing/dl 

tribution/dls^eminatlon/dif fusion, must be assesse*d as underdavalopad 

• , ^ . _ , 

and weak in their impact on the urer Bystam. ^I£ they are to be strength- 

ened, collaborative, fed6ral/state/lbcal and prlvata/publlc initiatives 

will be needed 5 designed specifically to take into account the essential 

requirements of the dissemlriation/ linkage functions and the current^ 

state of development of these functioris in, the field of educatidn. As 

a bajis for suggesting key needSj'we will review our understandings of 

i€s assessment basis and .current status. In our .discussion here, we 

will focus on dissemination* ' 

2U3 " . • • 
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"TM function of/ dissemination is critical to the entire R/D&t systep. * 
It 1^, In essehca, a linkage process which ''connect s'! knowledge producers 
with lo^owledge users* ThuSs as ^wa have :been Implying, the R/DW dls-* 
aaminiLtion system laust .provide/ for o^chaniams ^Ichi^ can determine %^at 
Is avallablei^ can sort out the "good" from the "bad"; will allow users 
to Idenplfy and obtain the particular products which are relevant to 
their needs; as neededs can "tailor" products to fit user^ needs; Can 
motivate users to "try" a product; insuraa Vffective user^ Implementation 
and utilisation. . ^ ^ 

Aaaessmint s-^then, must be made in terms of capacity to achieve and : 
success in each of the above requirements. Overall we would' wish to 
know this with respect to^ ' , " 

1. EK|tent and quality of "reach"' into user systems (e,g*i numbet 
being reached, the extent of repeat utilization of^ dissemination 
services, and user •aatisfaction with such service). 

2. Levels of user awareness and trial df R&D products (bk~ ^ 
istende, character , and evaliiatiya) * 

^ ■ . / \ ^ 

3* Cpntrlbutlon to implementation and utilisation of ^ 
prc^ducts. Since this depends on such other factors as^ 
number and quality of products available, user skills and 
receptivity, etc.^ the dissemination function can only be 
assessed as a contributor to the procegs. This must of^ 
necaaslty be a qualitative evaluation, 

4.. The existence of a well developed and cooperative network 
of dissemination mechanisms giving coverage across the 
^ nation and to^ the ^)^aplety of users to be found* 

K ' " . ■ 

Current Status . 

: ■ " ------ ^ 

In educatlo^ij we find a number of problems and barriers to dlssemlna" 
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1 "tlon. There fre an enormous number of users* (some I73OOO school ^ ^ 
'^districts ' - - plus taachers^ ete^)s %among whom thereMs'^ wide diver- 
sity 'and .variety as to philosophy^ ihterest^^ perceivfd nefedSs etc* 
Innovations make d^edands on the .time* of school personnel (a very 
practical matter) and generaMy reqUlre "people change" - - factors 
which can 'lead to reaistakce t© innovation, AdditiAally, at least; two 
major fadtors have.' tended to create , a very pd^or climate for dissemina= 
tion in edupatlon^ (1) a lack of implementation/utiliEatiork support 
to'^the UBer; and (2) the perception that the outputs of the (for 
the most part) newly created R&D Bystem have, generally been inferior 
to extsting user-developed products, * 

In educations there has be^ri a considerable amount of activity that 
has been called dissemlriition, and a large number and variety of organi 
Eations are involved ^n some kind of dissemination- = = but' much of 
this has been fragmented and scattered .(e;g.: "add-ons" to development 
projects; successful but separate and discrete dissemination systems 
for specific categorical programs). As ..yet , however , there is relative 
ly little coordination of federal state and local resources nation- 
wide ^ and no systematic way of tapping into the whole nationwide 
resource base. Further^ there is not yet a well developed personnel ' 
_ base of t^ained.di^semination_jpec_ialis federally funded _ 

programs have been developed in recent years for training dissemina- 
tion and utilisation specialists ^ but dissemination mechanisms are 
expanding far more rapidly and creating a far greater demand for 
trained personnel than these programs could even hope to keep up with. 



Key Needs 

From an overview perspective, thens the need is for; 

1. orchestration of educat lot^T^/D&I dissemination from a total 
system perspective | 

2. in the short term, ^facilitating the work of existing d is semi 
nation mechanisms ^d "filling" Critical "gaps"; 

/ 

205 



i [ ' ^ 1 ^ \ ' / , « 

3* in the long ternij providing for overall system building (this 
calls for polleies and s^ategies'whith are proactive ^ not 
passive or reactive 5 and which' are based on a knowledge of 
what does aftji|doea not in^fact exist); and 



f _ 



, 4,' balancing short and long term needs. 

More specif ically J . policies and .strategies federal funding agencies will 
need to be developed in collaboration with the states to focus upon^ " 

i,, quality control; 

2* mechanisms that can optimize produc t/dissimirtrtiony user - "fits" ; 



% ^ 

3^ providing users with alternative channels of access to the 
' ^ %, 
available resource base ^ (a '-mixed strategy^^ approach) • 

Keeping in mind the limited level and rate at which users c#n absorb new' 
input once a dis.semlnation system is astablishe4 (a factor which is of 
critical importance) * dlss-pmlnatlon policy will need either to eKpand 
the dissemination technical assistartte capability or slow the rate djf 
dissemination system expansion* To achieve a balanced and appropriate 
-growth rate, ongoing monitoring of the dissemination ^function will be 
essential. 



XV. ACqiAsiTIQN 



The weakness of the dissemination/ linkage functions and their minimal 
impact on the user system become particularly evident from examination 
of the acquisition procesa in the user system,. and the problems faced 
by user personnel i^ learning about and acquiring externally developed 
R&D outputs, I 
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1. A Virtually Non*Exl&tent Function ^ ^ ^ . \ 

The acquisition function is virtually non-existent' in education as an 
institutionalised activity, .The purchasing specialty that one sees in 
Industry is either totally lack^g^in e^&ucati^n or (where it 'does eKist) 
tends^to be highly restricted in scope to little more than handling the ' 
paper work of purchase orders and invoices, SearGhj product evaluation 
and assessment of bids are cc>^ibefi to , purchases of conventlDnal sup- 
plies and .equipment - e*&'i paper j crayo'nSs and chalk rather than 
teKtbookSs new curricula^ or instructional systems, 

r' • ■ ■ • / . ■ ' " ' ■ 

2 * C auses^ a nd E ffects of Acquisition Weaknesses 

The weaknesses of acquis it ion' processes^ in education are a consequence of 
two conditions: ^ / / 

1, The*^ inarkating/dist^ibution/dissemination/dif fusion systems in 
education have be^h so inadequately developed^ so diffuse in 
structure and so jincoordinated in channels that the educational 
marketplace is cMaotic in nature* 

^ ) 

2. There iff a gene'ral absence of specialiEed resouirdes allocated 
to the acq^uisition function* 

A * p i £ f Ic u 1 1 leg Fac ing ' U s er S y s t Per s onne 1 

ThuSj user system personnel face great difficulty in learning about or 
evaluating alternative progrms or products on the market to me'et 

a given need. There is no systematic mechanism to link potential 
users to available suppliers , or even to Inform the potential user 
^ about- who these suppliers are or what programs or products they have 
to offer, . ' - 



t^Bdivldual development organizations provide catalogues of their own output 
but there are few comprehensive guides* Even those few which/were .intended 
to provide comprehensive coverage of the outputs of a given set ^f ^ in- 
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stitutions 
(84) 



(30) 



. or the oatputs produced under funding from specific agen- 



(41) 



ci 

needs ^^T' tend to p 
±n a form less use 



or outpu^ts o^/fented toward specific areas of practioners' 

3vide less tH-an complete covarage, or information 
than needed. 



/ 



E, Absence .of/E valuative 'information 
'- - - - — — 



Perhaps mo/t critical of all, there are few gatekeeping quality .con= 
trol;mec^anl|nis to screen but weak innovations and there is little eva- 
lua,tlv^ infonnation about /aviilable products and practices* There have 
h4&ty4om/recerit initiatiires/ to provide validity/.quallty control mecha= 
nt^s on th.B federal and Istdie levels (e,g,: the federal Joint ofs- 
semination Review Panel dstablished to validate selected educational 
R/D&I outputs, and s tate I programs set up to validate ''exemplary ^ pra ' 
tices")* However^ these ha|/e been too limited to have sigrii^icant Im- 
pact, In the absence of well established widely used bases ,ffior rational 
decision, making about whether or not to replace existing prdqtices or 
materials with new products or R&D outputs, faddism has been c^racr 
terlstic of school system adoption of educational innovation. Even \ - 
where evaluative inforinatiop about a product is^made available to " 
potential users , validated products of this kind are competing with 
a large volume of nonvalidated products and practices. ^^^^ Thus/ it 
is still difficult for the potential user to make^ a rational choice 
among alternatives. ' . 



3^ An N I E _Re s p o ns e 

^lE has recently bfgun funding programs designpd to provide uniform, com- 
?arative evaluative information across 'cht? whole range^pf products and 
jractices available to meet a given ncied fe.g. : the 19 76 cj a talogue of NIE 
education Pro^ducts ; the ■product information packages accessed In ERIC; and 
lIE's Consumer' Information Program) . It will take some time befo re we wi 11 bo 
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in a position to assess whether chis new strategy has been effective In pro- 
viding some order to i 
acquisition functdon. 



vldine some order to the educational marketplace and needed sup'ports for the 



If this strategy is to" have as much impact as possible^ the target of ^hd' 
strategy within the user system^ will need to be narrawed* At present j^the 
acquisition entry points are scattered throughout the system. The awareness p 
interest 5 information search^ etc. that bring a new product or innovation, 
into the acquisition decision process may begin with teachers ^ principals ^ 
curriculum specialists, th^ Superintendent or miinbprs of his staffs or even 
parants or community residents — virtually anyone in the system or its 
enviromnent. This can be .a Dource of strength for the acquisition function* 
At present 5 however, it is relatively r^re to find anyone responsible for 
initiating and carrying out acquisition activities as a major part of his ^ 
job. Therefore the process remain^ episodic , haphasardj and random not 
well integrated into system' functioning and long range planning. 

. ■ ■ ' \ ^ ■ ^ 

There is suggestive evidence that the most innovativfe school districts may 
be those thai are best linked to the e|cternal resource system . either 
because of the prof essionalism'^ of the teaching staff; or the leadersh^ip 
orientations and style of the principals or Super ihtendent ; or the 
presence if external change agents; or especially the existence of curriculum 
specialists or coordinators on the staff who devote time and attention 
to determining what materials and products are available for acquisition* ' 
Thereforej initiatives to- improve the efficiency and effectiveness of the 
acquisition function by providing more and better linkages to the external 
resource system would appear to be a potentially potent strategy* These 
linkages could be developed either by providing more sppcialiEed petsonnel 
responsible within the system for stimulating and coordlnpcing acquisition, 
activities; or by providing materials or technical assistance personnel 
to provide this stimulation and coordination from outside^ the system. 

The latter strategy is at the core of NIE's new Consumer Information and 
R&D Utilization programs < Together ^ they propose to: (1) provide targetted 
materials designed to inform practitioners about what existing theory and 
empirical research suggest about specific problem areas; how this relates 
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emp^lary practices; and \ 



%o existing and eKemftlary practices; and WhsfAR&D products and programs are 
,availabla to meat given needs; .and (2) provide tecHnical assistance personnel ■ 
toifcielp schools selects adapt, install, and utiliEe available products ^and 
practices to meet their needs, *^ - ^ If these programs are effectiv.e;^ 
and widespread in impact J^'^he^ acquisition function will be strengthened and 
significant gains ^il^ have 'bekn m^e toward achieving the R/D&I system goal 
of improving erfucatitffiar pract^e. jAt ^present, however^ the acquisition function^ 
remains %andom and e^isodics and iti^ impact on school system functioning is 
'limited at best, » \ ' . , - 



XVI . ^ lOTLEMEKTATION AND UTILIZATION 



A Neglected Function 



Implementation/utilization has been one of the least understood and most 
neglected of the R/D&I f unctlonal .spec^lt ies in^ education --^ diffusion research 
generally ended at the point adoption decisions were made by school officials ^ 
, t^e/reby ignoring the implementation/utilization stages of innovation.- 

The^study of impXementation^utilizat^on was spurred by the contradiction between 
research .results that showed high levels, of innovation as measured by adoption 
decisions but low levels of Innovatidn when classroom practices lere observed. 
* As r^esearchers began to examine what happened to innovations after the 
' adoption stage ^ they discovered that innovations were in fact not implemented 
at all;^ or x^ere transformed during' implementa&tion into "more of the saipe old 
thing"; or %^;ere terminated as ineffective within only a few years. The 
failure of innovations to survive the instal lat ion ' and trij^al periods waa 
traced to two rather different kinds of problems: 




1, on the one hand, resLstancu to the innovations by operating 

personnel because of attitudes^ nonnl , and user system constraints; 
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2. on Che. other handj technical, complaxltics and difficulties requiring 
* . 

' capabilities beyond those of opferattng personnel (in the absence of 

imp 1 ems lit at ion slipports that were rarely provid^) * ^' 119) 

^ . ^ ■' 

2 . The Knowledge Rase . 

There^ is an eKtenslve *knowledge base about user* system norm^j values^ and ^ ^ 
yarious kinds of constraints that make teachers^ principals^ and other opeiiating 
^ personner resist certairi kinds of - Innbvat ions . ^ ' ^'^ \ ^^^^ .119, 125) less 
Is known about the' technical proBlems and the. kinds of implementation supporti^ 
needed to overcome these problems -- or how to idehtlfy potential technical 
problems; ass^ess user personnel capabilities in relat ion to^ theae technical 
problems;, and design training programs, ^technical assistance roles, and other 
required implementation supports, ^ However j there is suggestive evidence that 
the technical problems may be of far greater significance for determining the, 
fate of an innovation than attltudinal problems^ More prac tice-^based research 



and systematic evaluation of implementation support strategies will be .needed 

_ . " * . . r .' ■ 

to develop*^ an adequate knowledge base to permit efficient and effective attack 

on the technical problems of innovation implementation in education, 
( i — ^ 

3. Emprgence of Linkage Organizationn 

A number of types of linkage organizations supporting the Implementation process 
have been emerging in the education sector in recent years. We would include 
here: external groups such. as training organizat ions ^ technical assistance 
groups and various types 'of nducational consulting firms^; internal organiza^ 
tj.Q^nal units where they exist (e,g* : a school district *s teacher trainers 
OD and renewal teams ^ etc^); and especially the state and Interstate networks 

of school service organizations that have been promoted by recent state -and 

(91) ' * 

federal Initiatives. - T 

The implementation support strategies "tried by these organizations appear to lean' 
more heavily toward a clinical change model of working with, clients to adapt 
innov.ations to local circumstances as contrasted with the R&D delivery 

model of assisting, school districts in acquiring standardized products 
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developed by R&D organizations, Eowav&r beyond this geneVal orientation^^ ^ 
suggerted by Che litarature^ we know very little. about the .nature pr acope 
I oi this institutional bas%; how many organizations chare are, and of what 
various typ^; how chey are disCributed gaographical ly and by services 
-provided t ' how many school districts they i'eri^^e; what strategies they use 
and with what degrees of affect Ivaness ; what personriel bases and oCher resources 
.they draw on; the nature of thair linkages with KP as well as KU^ or with 
other linkage organizations; etc. 

4g HIE . , ' 

> . • ^ ■ . ■ ' \ 

The state ^and interstate networks have bean given incraased visibility and some 
incre^sfed support from NIE's sponscirshlp of its R&D Utilization program. State 
networks of regional intermadiate ^service aganclas have bean davalopad in 
approximately 25 states and son^ bthar states have developed lliplamantat ion 
support , programs using other organizational arrangamants . Interstate networks 
''of various kinds have also bean organized to link schools and^ districts 
dealiTig'with similar problems or using .aimllar innovativa approaches (e.g.: 
ES '70^ Schools; the Network of Innovativa Schools; and the RBS network of 
schools using Individually Prescrlhad 'Instruction) > The NTE R&D Utilization 
program described in a recent NIE RFP will fund ^ selected proajcts organizad 
into fotir configurations of implementation support aganciasr . ^ ' 

^ ^ .. '-^ ^ 

1* ^tate organized systems of intermediate service agancies; 
*' ' 

2p s'tate systeins not usin.i, intermediate service agencies^; 
' ? ^ ' ^ 

3. incerstate consortia of schools organized as groups of users; 

4.. interstate- consortia of agencies primarily devoted to producing 

(91) 

llhD ^ou t c nme @ and /or delivering t e c h n i c a L assistance*/" 

- ■ ■ y '* \, 

By specifying the type of □rganiaation that will be supported, this project 

' is .likely, to stimulate the de ve lopment of this kind of networking as well 

as provide support for alreaciy functioninfi networks.^. Th.e' data assembled 
* ■-\ ■ ■■ , ' . 

^' 

• ' ' ' 

■ , r . 212, 
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from this program and NIE ' s KPU monitoring progr'am are likely tp- increasG ' 
our under'Btanding of the institu'tidnal bases that exist for conduct of the 
impiementation/ut ilization support function; x^hat ^proportion of the 'appraKlmatel 
ITjOOO school dist#4cts in 'this counfi'ty are served by these organizations; 
the activities that define this functioti in the education sector; and 
perhaps also the relative effectiveness of different implementation support ' 
strategics. ^ At present, there is little ^in the literature to provide a clear ' 
picture of the nature and extent of the implementatiori/utilLzatiun support 
function as it eKists today in the educa Aon \s ector . ^ ^ 



XVII > SUPPORT SERTC^ES ' 

. ' / ■ ■ ■ 

I w changes in Support. System Patterns / 

As educational research and R&D activities have expahded in scale, the 

traditional research ^pattgrn of the individual scholar working relatively 

alone 'in his study or his laboratory has beep replaced by team research 

under compleK organizational and inter ^organizational arrangements ^ 

supported by a complex subordinate system of mostly sector ^spanning private - - 

corporations providing services and supplying and m^ntalning equipment, 

Iticluded in this support system are the traditional research support 
services e*g*p research libraries and suppliers and maintaine.rs of 

the equipment used in the laboratories. Also included, however, arc suppliers 
and . maintainers ^^of the kinds of equipment and services that distinguish tlie 
newer, larger-scale research and R6tD from the older, smaller -scale research 
and R&D pattern e.g.^ computer canters, data p^o^cesslng service 

bureaus, and computer maintenance services; the suppliers and maintainers 
of calculators, photocopiers, typewriters and other office equipment and of 
the Various kinds of audiovisual hardware that arc becoming so prominent 
in instructional system development; the film laboratories, videotape 
editing facilities, cassette reproduction laboratories, and printing and 
publishing facilities that, play such important support roles in the 
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4>roductlon of materials and complex multi-media instructional systetts; 
survey research service organizations that play a dual role- both as R/D&I 
performers .on projectfl of their o^.-'and as suppliers of support aervlces 
for other R/D&I organizations; and the various- mechanisms and arrangements 
that exist to protect proprietary rights for R&D outtputs that are not clearly 
in the public domain. Included too, especially for the larger and more 
complex projects, are secretarial and clerical services, generaHy but not 
always provided internally. ' ' • - 

I ' \ ' ' . 

2. An Inadequate Knowledge Base the Support Service Function 

There Is relatlvaly little in the published literature about the subordinate 

aystem of support services for educational R/D&I , We assume that there is a 

great deal of informati#ci In the files of federffT^ agencies arid R/D&I 

• Of gariizations that would be useful for assessing the scale, distribution^-^ 

* ■ 

prgan^atiqnal capabilities, and client service patterns of the various 
sirpport systems; the relative cost = ef fectivenass of the in-house vs* 
external strategies for supplying different support services (e.g,^ data 
proQessing or survey research units) for different purposeS(^ in different type 
of organisational settings; and the strengths and weaknessBS of various kind 
of procurement arrangements that are used. Transfer of support system 
^ management strategies from other sectors might be accomplished with relative 
ease once the configuration, dimensions, and service patterns of the support 
systecft, for educational r/D&I aj-e clarified^ and related to those contextual 
conditions that function as constraints on the procurement and provision 
^of aupport services for the educational R/D&I system. However, without 
such basic information j we are not in a position to attempt to transfer 
successful strategies from other sectors to the edu^atiolK sector , 



XVIII. EVALUATION RESEARCH 
1* His torical GonteKt 

^ — : ^ ' — — - t 

Of all the R/D&I functions in the education sector, evaLuation research has 

- " - ^ 
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experienced the moat rapid and extensive developmerit in the last ten to 
, twelve y6arsr' ' . — ' , ^ ^ 

Prior to the mid-^^Os, evaluation of educatipnal *^prograins (wtren it was done = 
at all),, was carrt'ed out by educational practitioners and by some researchers 
but rarely by people who identified themselves as evaluation research 
specialiits% The approaches tended to be normative, but rarely systematic or 
rigorouSp The predominant strategy was casual observation and , analys is • ^ , 
Conclusions tended to be 'based on expeirt opinions intuition^ and impression 
rather than systetnatically^ gathered and rigorously analyzed empirical data. 

This ptatteTrn changed signifipantly in the '60s as large-scale federally * 
funded social programs proliferated ^ and the legislation that created them 
tended^ to, require the systematic gathering , analyiis, and reporting of 
empirical tiata on prograjEi effectiveness. Thus, the evaluatiob research 
function expanded rapidly as a new specialty, even as a new industry: in less 
than a decade DHEW and Department of I^or evaluation contracts \expanded from 
a ^5 million to a nearly $50 million Industry. 1971 data fot DHEW evalu- 
ation contracts indicate that 74% of 'theee funds went to non-profit and for- 
profit res'earch corporations, and only 21% to uhlverslties or university- 
affiliated organizations , Many of the research corporations are sector- 
spanning Institutions, bidding on evaluation contracts in* education , health ^ 
personnel base development ^ , social welfare, and (in the case of some of the 
more diversified research organizafytons and . management consulting firms) 
industryj dafmse, and aerospace as well. ^ 

The eKpanslon and maturation of the evaluation re^^^ch function in education 
must be viewed as part of this broader developme*ht ^pf the field of social 
program evaluation showing the same large incre^es in numbers of 

avaluators and amounts of evaluation activity; the growlftg influence 

of research corporations competing -with univecsities far evaluation contracts; 
and the same kinds of attention to methodological , organiz'Ational , and political 
Issues inherent In^ the eVal6ation role. ' ' ^ - 
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2, Jlethodological Issues < ^ 

- — - r'./'^ ' 

.During the -60b and ^atly\\70s5 phere were many/|^t^p^aeba^ maong ^\ 

avaluation^ and researah thaDriats about^approprlate- methodolog id,s for the ^ 

ayaluation research function. One group argued thatrekp^riment.al (or , 

quasi-experimental) designs were raore powerful t^ian any ptber search 

approaches for asses^ng the effect Iv^enBss of programsV prbduGtSj or 

ttrategies -- and that It was therefore essential to use tjitbe" approaches to 

test outputs and to reform programs of all kinds. ^^^^^ A ^fiecond group argued 

that aKperimental approaches imposed unrealistic constralnti f ^'eld settings - 

and that at aily rate it could never be possible to meet adequa^^ly the 

statistical i design, and treatment assumptions on which experimental approaches 

, ^ (53, 135) ' " " ' 

are premised* ^ , * ^ 

Other methodological debates revolved around the need for evaluation approaches 
to provide feedback throughout the program development process — not simply 
telling the developer at the end of the development process that his program 
did not work, but working with him throughout the process to make it better. ^^^^^ 
iKlsfing pre-post evaluation designs made it difficult for program evaluators 
to provide this kind of feedback^ or to underatand how to evaluate a program 
stimulus that kept changine. J . . - 

Some of these disagreements have been eased by recognition among evaluation 
researchers that thare are a number of different kinds of evaluation services, 
each requiring somewhat different approaches ani techniques. The distinction 
between formative and summative evaluations represents one such difference ' 
Initially, the same researchers conducted both formative and summative 
evaluations, but over time there appears to have been some apeclalization of 
personnel and organisational units here. 

Currently, the formative evaluations that are undertaken as part of the*'R6tD * 
program/product development process are generally carri/ed out by evaluators 
who^work with developers as part of the ^ development team $nd provide ongoing 
feedback designed to improve the product or program being developed. They use 
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hoth qd^titative data-based and qualftative, Ji^dgmental ap^roaahes . Their 
style o£ functioning mphas^Ees flexibility* changing their research'^ 

questions^l variaBls^ s instruraeAfcpj and^approaches as the emerging program ^ 
takes shap*e and perhaps goea through a ^^mbtr of transformatipnsv 

The debate over ^experimental Va . other ^klnds of research designs is now cent,ere'd 
on sutmnative evaluations the "evaluations undertaken to test the effecttva- 

nesa of ^ given program or .product after it has been fully devaloped* Summa- 
tiva evaluations are usually done by an evaluation agency or organizational 
unit irfdependent of th^ program ' S'' developers , . Suiranative evaluations Include 
several types of evaluaWonE differing sjDmewhat in emphases because of the 
different information needs of the decision makers to whom they are addressed^ 

1, final operational field test of an R&D output to help the R/D&I 
. manager determine v^ether or not it is ready for dissemination; 

2* evaluations of the ef f ecClveness of a given program or product in 
a given school .or district in meeting locally defined objectives^ 

2> ^valuations of national program initiatives ^ sampling program* 
components nationwide to inform federal policymakers about the 
effectiveness of a given strategy (or the relative effectiveness 
of alternative strategies) in meet ing federally defined policy 
goals. . , 

There is 6till some disagreement about how appropriate experimental designs 
may be for product tpsts and for individual . school or school district 
program evaluations; and many other kin^s of *esearch designs have been 
proposed for these types of evaluations* Nonetheless ^ a federal program 
avaluation policy (to whatever extent such a policy eHists) appears to be 
moving toward eKperimental approaches increasing numbers of national 

program evaluations are being conducted using experimental designs j control 
groups s and some randomization of treatments * ^^^^ However, the difference 
between feKperlmental setting iUv the labor^ory and the field is gaining 
recognition,, Federal evaluators are increasingly acknowledging the need to 
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sujjplement Impact ^data with process data demoristrating that a given' "treatment" 

was in fact implemented as specified ^in the program design, and that the 

Impact evaluatdon ik a valid test of the program ^and not simply a "rion-event *" ^^^^ 

Ot'tierwleaV questlons\ can readily be raised as to whether a program evaluated 

as a ifallure* was In met -a' failure - - »-T^h«her Instead it was never 

even tried (an4 thua "what w#s evaluated ^nd Judged a "failure"" did not in 

reality even rasemble ahe- specif led ^progra^. 'treatment*') * . - . 



Orgajiiaatj.onal and gcbliticar Dilemmas 



A, The EyaluatQr ' s ^bUe 

\\ 

The evaluator ' s role ha's\ corns to be understood -pi imar ily* a,s one of tteetlng 
the information needs of ^ ^decision makers, ^ H^ever, there are 

a number of (issues and probl^nis involved In this ' assumption, ' For eKamplei 

■■^WhlQh detisibn makers a^^ we talking about* implementation personnel? 
program managers at specific sites? program' manager^ at the localj 
state and/or federal leVel^ policy makers (and at what level) ?^ 



How does^the e^^aluator deal with the dlff-iculty deel's4on makers have 
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in defining their inform'at ion Naeeds ; In- agraeing dn what information 
ls_ relevant or in agreeing on wV^at measureniaht prbc^durei and ' ^ 
^ instrum^t^s are valid? , \ . , ■ " b 

How much input can an e valuator hava in defining what he investigates? ^ 
Must he accept , the client's definitio^ of t+ie program's objectives and 
singly assess the effectiveness of the\progj:^ara in meefidng these 
r-cb lectives? Or can he include in his e^luatlon consideration of 
the apprppr iateuess of these objectives (ar the program^g ratignale 
or sttategy): for meeting the ultimata goal ^ the program's developera?^ 



The Poj^itical Dileirana 



.Evaluations are often described 




n?inar,at'auii^t ' toolB d^^signcd to provide 
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i "rational bails for dteeis ion making*' -but decision makers in the 
publift saetor functtoh in a largely political sphere. .This fdct raises 
important Issuea for the evaluator on both theoretical and practical levejls* 

On the theoretical level we must ask if political considerations are 
"irrational J *V or If they are baseJ on "a different model of ratlonali^ 
froni the one generally used by social scientists * 

On the practioal level, consideration must be given to the polit^s of 
decision making. Generally; speaking^ programa are created .by political 
coalitions of diverse Interests — f Interesti which support rirograms 
for diverse reasons. These coalitions teiili ^to view negative aWluation 
research findings unfavorably — ^ and generally have enough infrti^hca 
to modify or bury "negative findings and keep their programs going 
regardless of what avaluatoors report. Conversely (yet similarly), 
programs may be opposed by other political Interest groig|s interest 
eroups who will use findings of evaluation resetoch to achieve their 
ends* Thus* evaluation research findings may be usedj misused, modified, 
reAterpreted, burled, etc. ^^^^ — in other words, used as 



a ••political football". Given the political context and the methodological 
Issues we have njfed above, it is- not surprising that co&«g3^rsy over 

W ■ ' ■ ■ £ ' 

nMatlve Valuation research findings are so. often phrased in terms of 

" ■ • ^ ' ' ' ■ ' ' 

methodological issues rather than evaluation findings per se. 



the "Value" DileTOa 



The educational conteKt is value-laden, and value choices ^ enter virtually 
every one of the key decisions made by the evaluator. The outcome of 
evaluation research may be predetermined by the choice of research questions 
tad objectives, the criteria used in Judging ef^ ::iveness, or the measure- 
ment instruments administered. From the hwmn P ^^pectlve, the qi^estion 
must be asked I Is the evaluator value-free when ^ing evaluation research? 
From the organizational/political contaxt perspective, the queitloti must 
be' asked I To whatt extent is /should these » key valua decision choice^ of 
the evaluator be Influenced by the organizational Information needs of the 
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deelslon maker on thevone handi and the politlcai context /djmMlCB on thfe 
other^ hand? 

D. Cutrettt Trends ' ^ \ 



Evaluators are devaloptng an iricraaslng sansltlvlty to tfie politics of 
daQlalon making. The evaluation resaarch lltarature has shown the 
progress taada^*by tha' f laid over time In coping with this situation 
from pn early litarature that sl^ly bemoaned this situations to mora 
recent wrltlhgs that accapt It as a given and build consideration of 
tha politics of decision making into the planning and imp lamentation of 
evaluations to maka tham more "stratagically useful (75 , 146) 

The avaluatipn research function la In a ^much strongar organizational 

and political position now than It was a decade ago* Instead of Being 

located In marginal units that could be easily Ignored ^ planning and 

evaluation units and their admlnlstratora are now included In the top 

f43) 

^^nagement d e c 1 sXo^^steMC tuj;e 
tion research function Is taking on increaalrig proinlnenca in the 
General Accounting Offic^*s auditing activitlfs. ^^^-^ the state 

la^lp., legislative oversight committees with strong evaluation research 
staffs of their own have glyen significant visibility to evaluation 
research activities and findings, 



4t The -Impact of Evaluation Research in the Education Sector 

~9 " . ~ - - - ^ - ^ 

There is still substantial disagreement over just how much impact the 
evaluation resaarch function has Had (or can have) but clear ly, 

thara is relatively little evidance of extensive use of evaluation 
research findings as the basis of poltcy decisions* Equally clearly, 
ralatlvely few high quality evaluations have been prodaced and even the 
better evaluations have suffered from serious methodQloglcal flaws. The 
field of evaluation research lacks an adequate thaoretical basej and is even 
mora lacking in adequate instrumentation. There is no clear federal 
evaluation research policy, and federal agencies have not even issued 



22U 

o ■ 
ERIC 



guldgltnas as to what constitutes an adequate or appropriate: evaliiatipn. 
(OEp though, has been moving in this direction and beyond for the evaluation 
of ESEA Title I progrms)» ' V It would seem, then,, that the 

svaluation.resemrehftoetion in the federally funded social program field 
retnaina weak in comparison to the evaluation research function In mature 



XIX. ^SEARCH ON R/D^I 



1. AvailabilitY of Analysis and Empirical Re-search 

Given the ^elatlyely brief history of educational R/D&I, there Is an 
^astonishingly large accumulation of analyses and empirical research on the 
functioning of the systetn*^ This is attributable in part to the negative ^ ^ 

political climate in \rtiich the system functions the lack of confidence 

in Congress and various federal agencies in the educational R/DW enterprise. 
As noted earlier, there has been a tendency tp pull the system out by its roots 
every couple oFyeair tS^^^^ 

effectiveness might be improved; A large ^^^^^^ these^analysey^ 
by or for federal agencies or Congressional coBmlttees, 'V, 



A second factor of soma importance in accounting for the large number, of 
analyses was the increasing self ^consciousness of the social sciences in the 
late '60s* as to their proper role in relation to goverimiental agencies and the 
utilization of social science'knowledge* Some of the relevant literature was> 
provided by study committees of the National Aca^my of Sciences ^ National Researi 
Council; the National Science Board; the National Academy of Education; and 
the President's Science Advisory Gbinmlttee,^ ^ ? ? ;^ 



Some of the relevant literature Is traceable to an International stimulus 
a request from the Organisation for Economic Cooperation and Development (OECD) 
for OE to participate In a cross-national review of educational R6^ and an 

analysis of how 'RM) might be strengthened to increase its potential for 

J . , (73, 109) 

improving educational practice. 



Somm ofT^ha more recent literature is the result of the emergence of know- 
ledge produption/^y^tilizatton as a new research .area in the educattorial research 

But probab^^£he most impDrtant tapetus of all in recent years has COTae.froiii 
the BpdnsQrs of educational R/D&I (not only Ol' and NIB but also private 
foundations such as Russell Sage) — e.g.i their increasing Interest In 
eval^tlon research as a basis for policy formatldn- their Initiatives 
to support^ design^ development, and utilization* of routinely collected data 
bases im monitoring the progresa of the educational CTU aystemj detecting 
prDblema, and fietermining the impact of policy Initiatives. 92, 95^ 122) 

2* "Types of Studies In the Literature ^ 

The .Tlterature can be categorized into five types of studies i 

• •) 

1* distdllations of expert analysis and oplnidni 



2, systematic empirical evaluations Of particular components or 
outputs of the educational R/DSI system; . 

3s syntheses of the relevant literature; 

4* ease studies of eKemplary educatiohal R/D^I projects; and 

5, descriptions iof the KPU data base and monitorin^""^stem that is 
*being develop^^ under Nil auspices, Y^^^ 

Most of the relevant literature (and virtually all of it that was produced 
during the first five or six years of the federally funded system's history) 
falls Into the "distillation. of expert analysis and opinion" category* These 
analyses were generally based on interviews; site vlaits; ekaminatlon of 
materials in agency files; perusal of system outputs; or the insight of scholars 
working together to form judgments and make recotoendations. ^* 15, 16) 
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• / " ■ \ . ■ ■ ' ^' , V .o^ ■ ^ ; \ .\ ^ ■ . ■ ■ " ; ■ ■ 

Systeinatlc empirical Irtvestlgatians Mke up the second largest category " ^ 

/■ . ' ^ ^ ..>•■■' -vv ^ (124) ^ ' ■-' _ - ■ - 

e*g*l evaluations personnel training vpt^osrans ; or ERIC information ' 

pifdduatii^**^* or pilot^ state disse^nation projects I ^ ^^-^^ 

oi AERA meetings and journal publiqatlons as critical elfmfents in the O in'for-» = 

oatlon- f low system Iti educationi' * etc- I J * , 

We include here espellally several studies of the evaluation research function ~ 
how it la organlEed; who does what kinds of evaluations with what degree of 
effectiveness I how evaluation findings are used| etc.^^' The "research- 

on-resAarch" character of these studies of the evaluation research function 
' suggests a particularly high level of self-awareness within this function* 

Th6re are relatively few documehts in the other three categories. The literature 

that is available clearly reMects the instltutionaliEatiojA of "research-on- 

research" in educational R/D^l ~ efforts to Synthesize the existing literal . 

turei^^^* ^^^^ efforts to map the domain of educational R/D6I| 

and descriptions of.NIE's TOU monitoring project designed to: develop a data 

base on educational CTU functioning; use the data^ base to build mddels of the 

dynmics of CTU functioning in education; and monitor KPU fi^ctdoning t^ 

identify problems requiring new policy initiatives or to assess the effects of 

(92 95)' 

existing policies and policy changes . ' 

At present, the researah. literature on educational R/D&I functioning touches - , 
on only limited areas of system functioning; provides relatively little 
empirical data;- is atheoretical} and appears to be only minimally utilized 
by either sponsors or performers of R/DSl activity. However, all of this may 
hhange if the NIE monitoring project is effectiVii in institutionalizing research 
on the educational R/DSl system and providing the^kind of data base and policy 
analyses suggested in current project descriptions* ^ ' 



XX, CONCLUSION 

We have throughout this report noted weaknesses in the educational R/D&I 
system. It is important now to re^emphasize that we have alsp noted that 
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irtiat we have fojmd w©ui|.he generally ^at one would expect to have found 
within a relatively young ,R/Dai aystem. TJere has been progress, and ^ 
thare ara aig^s of ^ the beginnings of a tranaitlon from the introductory 
8 Cages of, sya tea development- - . * * * . ^ 

Thus, as we noted at the outset, Ithe current state of the educational 
R/D&I aystem must be assessed in terias of where it has been and where it 
now has the potential to go - - not in terms of imrealistic expectations 
about ^'progress and output to date". / 

With this perspective in m^lnd, we can see the last two decades as a period 
of some important achievements, in the cceating and building of the educa- 
tional R/D4I aystem in the United States. As compared to twenty years ago i 

1. There are today some 1500-3000 prganizations (academic, private, 
and public) which have R/DSI* capacity = - most of this capacity 
being relatively nu-^ and being largely the result of federal 

The personnel base has doublad (perhaps tripled) - from 
around 4000 in 1969 to 8-12,000 in 19?4. Most of this work^ force 
is repreaented by raaearch and development personnel- 

3. The educational R/D&l system has produced a substantial number 
of outputs* Some of these have been outstanding quality and of 

^ a widely reported Excellence - = products from RfiiD organizations 

and exemplary products which have been identified, generalized 
and widely disseminated, ^ 

4. Some linkages have been developed between some of the strong 
development organiiattons and the school systems who have been 
using their products. 
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Si Since some degree of mturity of a knowledge/teGhnology bas^ 
is necessary to allow its cqdificatlon Into handbooks and other 
eyntheaes, we may infer some beginnings of educatlonar R/D&I 
system 'maturity from the Increasing level of availability of 
such handbooks/syntheeea* * 

As the R/D^l system has matured, inevitably some of the functions have 
developed and/or been supported more than others. It will be Important 
to maintain a "balance" between these various functions of the educational 
R/D&I system. This balance must take into account for each function i ^ 

^ the ?ime period needed to produce significant outputs; 

''theF JjQpact^ each futiction has on the other functions; 

the level of funding nefeded both to maintain a balance and to 

maintain the basic integrity of the personnel and institutional 

. . ■ ^ - - . ' -. . - 

base within each function. 

4, what currently does/does not exist within each function (in 
terms of outputs and of the institutional personnel, Imow- 
ledge and technology bases) * 

In siflnmary, the period of the last two decades has been an Important era 
of initial sy^em building for the educational R/DI?I system. There remain 
problems s weaknesses ^ critical gaps to be filled, balances to be achieved 

- - as one would expect to find in a relatively young R/D&I systemft 
These Identified needs become the focus for system buildin^^jid rebuilding 
for the next transitional phase for the next five to ten years* In this 
period. It will be vital to provide continuity, stability and security In 
order that the educational R/DSI system can take root, grow and develop 
maturity* Only in these ways can we hope to develop a maturing educational 
R/D&I system which can have ^significant Impact on the educational system 
in the United States* 
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CHAPTER FOtjR 



THE R/D&l CONTBCT INJTHE CIVILIAH AVIATION SECTOR 



Sincfe 1959 the term ''aeroapace industry^ haa bfien uBed^ denote the Industrial 
sector serving both space and aircraft development and production. Space work 
has been almost entirely devoted to serving- the federal civilian and military 
exploration programs, while aircraft manufacturing serves both military and 
eomerclal users. For our purposes, discussion of the space and military air- 
craft cases would involve Issues of lesser interest (given the specific nature 
and requirements of the users) than the case of the civilian aircraft .industry, 
although, as will be seen, it is not possible to completely separate'¥hese sub- 
sectors. Therefore, the primary focus of our contextual analysis will be set 
within the civilian aviation Industry. 
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I* ' EOTIRQNmNTS OF THE .R/D&I SYSTm 

l^N pQlltleal Conditloni 



A. Federal Funding j 



Fedaral funds going^ tnto Industrial Rfid3 in the aerDspace Industry 

have tanded to axceed company funds In tha ratio of about 5 to 1 
- (13) ' 

(DOT ). As wa noted above^ aach of the signlflcmt stages of 
devalopment in; aircraft technology batWeen 1926 to 1971 ware preceded 
by periods , of government fundad R6iD, On top of this, it is federal 
money that supports the work of MSA , the source of most of the 
basic research in the field. Not surprisingly therefore it has been 
in the Congress and In the Executive branch (Including at NASA itself) 
that much of the decision making on the rate and direction of equip- 
riant R€^ has been made. Additionally the roles of FAA and DOT have 
been significant in the determination of airline policies and 
procedures p and in turn^ on policies and procedures of the manu- 
facturers of airline system products* Whether we are raf erring to 
prices, scheduleSs safety^ flight patterns, maintenance requirements 
etc, it must be remembered that the airlines industry is highly 
regulated. 



By International Relations \ ^ \ 

Another Important political aspect is the role that aviation plays 
in international relations, Havirig a major airline has long been 
a matter of national prestige. Even small countries that can ill 
afford the Investment support their own flag carriers (even at sub- 
stantlal loss in revenue) for reasons of prestige or for security 
(as might be claimed^ for eKamples by Israel*)* 
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Equally (or more) important has bten the fact that most of the f^ee 
wo^ld flies in toerican made equipmantj thie ttoe with economic as j 
well as political ^plications. The Anglo-^French Concorda project . 
^ is at least as much a political as an economic venture.^ In fact / 
it is probable that flights of these planes will nee4 to be (and 
will be) highly subsidized by their respective goverMaents to help 
establish them in the marketplace. The present political battle 
over landing rights for the Concorde hag been said to have major 
implications for U.S. relations with Britain and France, Also, 
considerable conjcern exists over the possibilities of the U.S.S.R. 
becoming a source of aviation equipment. 

2. Social Conditions ^ ^ 

This has all been taking place during a period in which social acceptance 

^of airline travel^^ has becoma Established , During a period of approKimately 

25 years revenue passenger miles has increased an average rate of about 

13% per annum^ rising t6 20% or more in some years Over the period of 

the last twenty years both total world and U.S. airlines have experienced an 

approximately twentyfold growth, and estimates for the 1976--85 period are 

for 50 billion^ dollars (worldwide) of comaeraial aircraft deliveries (at 

(13) 

constant 1974 dollars)* almost as much as in the previous 25 years 

The enormous and growing demand for the service and the product (.coupled 
with the tremendous rate of change of the technology) indicated a user 
popwlatlon that was "pulling" new R/D&I outputs in a ffli«st intensive 
manner although Schif^el believes that traffic growth acts 

as a "permissive" factor rather than as a cause of aircraft technological 
Itmovation and acquisition by airlines. The fact is that the use of the 
airplMe as a means of passenger and qargo transportation is established; 
and there Is a pattern of expectations for continual Improvemaat in 
service (allowing for the effects of fuel crises^ etc.)^ even though 
demand may now have stabilized. 

^Although El Al does not in fact represent such a drain on that economy. 
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^» Eeonomle Factors 

' /■ ^ ; / ■ " ■ ^ * 

A. Faderal Expendicures 

Changimg patterae of faderal s^wdl^^^^ 

anormous impact on the aeroapaca industry. Tha industry rhaa a ^ 
raputation of faast and famine conditions * with major layoffs and 
rahlring of avan tha most qualified parsonnal being comon. The 
fedaral bail-out of tha LocWieed Corporation is a well Imown avent. 

As we stated above, federal funding for aeronautics R&D has been /^""^ 
substantial. During tha nine years pf 1967-75, approximately seven- 
teen billion dollars was spent by the federal govarnment, with nearly 
two billion of this' in^ NASA* Further, the trend has been up 
approxl^tely 30% over the overall period, and almost tripled at 
NASA (reflecting a shift back from space to aeronautics R^cD) . Such 
a level of support can hardly be Ignored, 

B. The Technological ^ Economic Interaction ' 



It is also a fact that It is difficult to undarstand the technological 
and R/D6tl system issues in the aviation^ industry without an apprecia- 
tion of the effect which economic forces and structures have on the 
producers of aircraft and their airline industry users. Let us 
examine this interplay of these techno-economic relationships* 

I* Airlines " 

Airlines are oligopolies, highly ;^ regulated in the U*S, by the 
Civil Aeronautics Board (CAB). 'Fare competition is virtually 
non-existent both for maj_Dr national airlines and in the Inter- 
national contest (under lATA control) , ' 
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T»o-thlrds of the dtivestmetit of airlines is devoted to purchase 
of aircraft,* Given Indus try-wldie price eontrbls, co^etltlon Is 
transferred to service. Image -and operating cost differentials. 
To a considerable degree, as Schlffel ^ ^ - and Gellman ^ ■ 
recognized p the acquisition of new aircraft by airlines becomes 
a co^etltlve device anfi as we would note, a defensive 
strategy (you can't afford to be using obsolete equipment at the 
same ticket price for less service). This strategy has been made 
possible by the continuing pattern of increasing demand (traf f lo) , 
at least 'Up to recent times. 



2. Aircraft yroducers 

Aircraft producers (essentially the airframe manufacturers) are, 
by now, also members of a highly. concentrated oligopoly, with only 
three aajor manufacturers (Boeing, McDonnell Douglas and LocWieed) 
left in the U,S* Industry (which i^^praptlce represents most of 
the non-eonmunist world civilian aircraft capacity)* Other f 1ms 
such as Convalr-and t^rfiln have been forced out of the CQmpetition, 
^wlth ever-growing tooling costs demanding long production runs and 
hence concentration permitting economies of scale. 

Demand for new aircraft, while growing at a substantial rate, is ' 
not easily or quickly expanded beyond this pattern. The limited 
number of major airlines seek to minimize the variety of aircraft 
they use for a specific application (e,g,r long vs, short haul) 
in order to keep down operating and maintenance costs. Aircraft 
have relatively short first-line life cycles^^ because of rapid 
rates of change in technplogical opportunity (frequently deriving 
from technology transfer from the military sphere)* 



* Recent trwds towards leasing aircraft from equipment ttust funds may 
be helping airlines to alleviate this major financing problem. 

# Although equipi^tft may be kept on for less competitive applications for 
15-25 years, /and evin longer in the aftermarket, 

^ u> ^ . 
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The previously mentioned shift to service differentials (as opposed 
to price) as the arena for airline competition creates an enormous 
ineentlve for producers to be on the market with new products 
first — or not far behind. Becauae diffusion rates for adoption - 
across the airline Industry is rapid, airlines must commit them- 
selves early to a new rrfnge of equipment - and the latetfomlng 
producer is squeezed out. The consequence Has been fierce techne- 
Ibglcal competition between manufacturers. Further, unllfce certain 
other fields, it Is virtually impossible to play the role of a 
technological follower who substitutes marketing "clout" for tech- 
nological Innovation. The performance characteristics (speed, 
range, capacity, ' noise, operating cost per mile, etc.) are too 
clear and quantifiable across, most criteria to permit manipulation 
of a sophisticated customer, the airlines. 



Other Economic Fac t o rs 



Recent public concerns with environmental effects (noise pollution!' 
, etc.) may act to herald in a new wave product innovation that the 
airlines will not be able to resist, despite the negative economic 
Implleatlons that this would have on them. 

J 

The changing economics of fuel may force the Introduction of aAre 
economical equipment. Thus, for example, the airlines and airframe 
manufacturers have in the past shown little. interest In the NASA 
super-critical wing technology that could promise a few percentage 
points of Improvement In flight performance (and hence reduce fuel 
utilization). The arena for cost reduction aa the airlines saw it 
lay In the total cost of operations more than In flight costs. " 
While this still may be true, the sharp jump In aviation fuel 
prices has led to an upsurge =of Interest In this new technology. 

Another Important consideration has been the substantial role of 
aviation exports (civilian and military) as a factor In the U.S. 
balance of payments, and the Increasing threat of foreign corape- 
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tttl4Bn* . Iti 1971 MBtoBpktm ekpofts surpassed 4 billion dollars. 
Brlzendlne ^ ^ testiraatad that 93% by value. of the frae world's 
civil trtMport eama from the U.S. The ten year foreeast for the 
total market is ovpr 50 billion dollars.* In auah an enviroimsant 
RSdD vmat and does reeelve a high priority. 

4# Sciantific and Tachno logical Conditions « 

A. A Well Davalopad Scientific and TechnoloEieal Field 

While the history that we have preeented spans only seventy years ^ 
;the scientific roots of some of the central disciplines can be 
traced* back to the contributions of Leonardo da Vinci , Gallllaoj 
and Newton, with later work by Leotdiard Eular and Daniel Bernoulli 
in aerodynamics* . 

Modern aarodynamics dates from the turn of the last century with 
^ the work of Lanchester In England | Kutta^ Von Karman and Prandtl 
in Germanyi and Zhukovski in Russia. In the years sinces the fieldj 
with its associated fields of structures md materials ^ has become 
a highly developedp scientific and engineering based specialty^ with 
substantial exparimantal faciilties such as wind tunnels being 
constructed. Aero engines data from 1851 (by the -Franchm^^^iffard, 
apgliad to airships) and from the work of the Wrights and Manly 
in 1903 1 with continued and accelerating developments through the 
aecond world war. The work of Whittle and others starting in 1939 
in England and Garaany ushered in the jet age in the mid-1949' s. 

In the Internal combustion and jet engine technologies , we are 
by now dealing with a very well understood and documented field, 
amenable to classical processes of scientific and engineering 



*lt is to be noted, however, that return on sales in the aerospace industry 
has tended, to be around 2,5 to S.CTA compared with about 4,5-5.5% for all 
manufacturing fi™s, although return on stocWiolders equity is about the 
same (DOfT,^^^^ p. 68). 
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improvraent. The advances in aeronautical electroniaa are more 
reeent but fall into the mamm pattern, with especially rapid a^ 
vanees In recant yaara with tjia progress of the field at large* 
All together the subf ields can generally be seen as highly special- 
ized, scientifically , and angineering basedp and highly codifiair. 
Standards are a way of life for every detail and feature. 

An exception to the above pattern Is ^the mora recent concern with 
hiuoan factors and use characteristics* In th^se areas (e-g*i as 
these might relate to cockpit and controls designs to provide high 
effectiveness, low fatigue ^ etc*) and in the areas of passenger 
facilities designs, etc^ less developed areas of knowledge are 
being used. Similar problems arise in considerations of the man-; 
machine system aspects of flight, coimnand and control^ safety^ . 
etc. * 

fi _ Jnno va^lon_s_ * Abr u pj or C umu 1 a t i ve ? 

We would be remiss in our discussion if we lead the reader to 
conclude that there is a continuing "*£low of radical and large scale 
Inrfovatlons stennning from fundamental (i.e.* "breakthrough") change 
in the state of the art leading rather abruptly and automatically 
Into major new applications. There have been (and continue to be) 
considerable and contitiual advattce^ — in compuiie Ttt^ and m aterial, ■ 
some traceable to fundamental advancas; and these surface, from 
time to t^ej in new aircraft configurations and models having 
radically upgraded charactertstics . But it could. also be claimed' 
that i-i'- a have been no really radical innovations in aircraft from 
the timu of the first jet planes up to the recent NASA developed 
super-critical wing technology. It can be claimed that .what we 
have rten has been a series of cumulative (though very significant) 
improvements- This is a perspective that is open to much debate, 

but it Is congruent with the view expressed by Abernathy and Wayne 
in their discussion of the "learning curve." Regardless 



of which viewpoint is "correct'S we should note,, that the net result 
^of iimovative activity In DOD, MSA and industry has been a vary 
significant trend of perfottoanca improvement over the last few 
decades * ' ' . 

C, The Technological Imperative vs^ User Needs 

Th^ Itoportance of technology transfer from military to" civilian 
iviatlon has already been noted. Such effects can be seen klong 
the i^ole history of civilian aviation, through the various wars. 
Into the Jet age and eveti recently with the wide body jets such as 
the Boeing 747 (coming from the Air Force C5A built by Lockheed) * 
The developments generate^ In this way have tended to push techno- 
logy In the directions of greater spjeed^ range and capacity. Thuss 
over the last forty years civilian aircraft have increased their 
cruise speed by a "factor of three; their range by a factor of ten; 
.and their capacities (pay load) by factors of twenty to forty* In 
general p though not always, there have also been comparable Improve- 
ments in economy; and measurad on a cost per seat mile, there has 
been a one-third reduction over the aame period. 

However, as we pointed out and as we will demonstrate later, the ' 
objectives of R/DM progrmns in the military and civilian spheres 
are not alike, given the varying patterns of needs. With much of 
the new aviation technology having flowed from the military. It 
was only to be expected that rate and direction of such innovation 

did not necessarily match the changing pattern of needs of the air- 

if 

lines or the ultimate consumers (paisengers and shippers of freight) * 
As a consequence, new technological opportunities were being opened 
up in ways and at a rate that were not necessarily to the advantage 
of the airlines to Implement and exploit ^ but xdiich they found 
themselves being forced to adopt because of the defensive non-price 
competition we noted earlier. These conditions lead us to look to 
the producer as the source and stimulator of the technoloelcal 
innovation process vis a vis the airline users. 



There are, however ^ other causes that point in th© same direGtion 
and ^Ich might be eKpeetad to continue even i^h the absence of 
the external military source of technology. An airpl^e is a 
highly complex multi-component system, with many of these com- 
ponents operating close to their technological limits and using 
state of the art knowledge. As advances emerge in materials ^ 
atructuresp configurations , electronics ^ and engine design, new 
technical possibilities appear. These developMnts may have * 
derived trcm many sources , inside and outsida of the aerospace 
R/DSI systems* The repaarch and design fields are so specialised 
that one time we may see advances in fuselage design; at another 
in flaps or wings ; at ariother in controls and so on. A new air* 
craft system may, as we noted, emerge through an accumilation of 
many improv^ants in many components sometimes adding up to 

a substantial upgrading in performance.-^ Again, such improvements 
may or may not coincide with user demands but the technological 

imperative and stringency of the technological demands nonetheless 
require sitcraft and component ^manufacturers to be pursuing ever- 
continuous programs of research and development, 

D. Signs of Increasing Civilian Aviation Autonomy 

The drive of eKtarnally (military) lueled innovation may have 
culminated In the 1970 SST program. We will discuss the goals 
of aviation R/D&I programs- later, but for now we may recognize 
that an SST maets virtually none of the objectlvas that se^m tp 
reflect the naeds of airlines for new gan^rat^ns of equipment. 
It represents only an improvement in speed (made possible by the 
generations of supersonic military airdraft now in servica) . It 
LS retrogressive on capacity, fuel consumtion, range, cost o£ 
oparation and environmental aspects. This J&es not Imply that 
SSTs will not find a place in the market. Rather, the dabate may 
indicate a maturatton watershed for the industry. We earlier 
indicated 1970 as^the achievement of full maturtty. It may be 
that it marks the point at which the civilian aviation Industry 
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began to pull away from the tailitary source of tachi^ologlcal 
innovation perhapi even leading to a mora cctapleta separation ^ 

of the military and aivltian; sectors. The implications could be 

' (29) 
to make the patterns of innovation so well 4i^cussed by Sahiffel 

less relevant for the future trends. 

Related technological developments may be^ going on in the lass 
glamorpus areas of aviation imiovatibn. In response to the gro^ng 
potentials In developing countries (in the freight business^ etc.)t 
there is a growing interest in supplying low cost, short take-off 
tod landing aquipment. A combination of closer fitting of products 
to User needs, a substantial after-market (used planes), a growing 
concern by alrlinis ui influencing the emergent features of the 
equipment they purchase, and the pravioMsly mentioned increasingly 
close coupling of NASA^aircraf t research with the civilian aviatibn 
industry, may all be signs of the growing autonomy of the' civilian 
aircraft industry* % 

Sfflxnary ^ 

The nature of the aviation Industry makes it vital that we racognize 
the extent to \Aich the industry lives on its technological in- 
novation base and the 'degree to, which its policies and strategies 
are tjaclmologically determined* 
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■r ' II* - HISTORICAL DEVELOPMENT 



1. Devalopmant of t he Sector and; the R/^&I Systaro* InatltiutlQnallzation - 

The R^lil proeass Iti civilian ^aviation could be describad as highly institution- 
all2e4^. More thfin seventy yeari hava gone 'by since the first succassful flight 
in 190a. Since \than a highly developed and speciali^ad industrial sector has 
grown uA with a Veil defined division of activities both as to research and 
daveloTOfint and ^oduction roles. SuBatantial and spacialigad 'companies (efg.: 
Boalngr McDoTmej^Dougla are^to # found in the areas o/ airframe Catrcraft) 
manufacea^g afe wall as in engines (e*g* i General Electric) and In other 
equipment /f^luding segments of the electronics industry). In addition^ the 
National Aer^autics and Space Admiiiistration <^A) which waa established 

In 1958 to replace the National Advisory Coimnittee for Aeronautics CNACA) , 
founded in 1915 has well defined responsibilities in the more basic Km 

areas. The . Department of Transportation (DOT) and the Federal Aviation Agency 
(FAA) have clearly deliniatfed roles in the Implement at ion evaluation and contro^ 
of aviation systems. . 

■ " _ " " - - ^ - ■ ^ 

A. The History of Industrial Development ^ 

. ■ ~ ^ " " ' \ ^ 

In a history of the u/s. Aircraft Industry, Simonson ^^^5 des- 
cribed the period of 1903 ^ 1930 as that of the early industrial 
development. Stekler <33) described the 1903 to 1914 period " 
as being that of initial development.' Up through the end of 

1913 only about 100 airplanes had been built. Stekler refers to 

1914 to 1939 as the World War I and interfear period. During this 
period production rose to a ^rate of l^^OOO planes per year in. 19 IS"; 



Several sources were especially helpful in supplementing the experience^ of the 
authors with this sector. They arti AIAA ^^^^ 'CA_B,^^^^ DOt s^"^^ 
Schiffel, Simonson \ ahd Stekle# r^. The cotaents of Drs . Alden 

Bean of NSF and Frank A. Spencer of Northwestern University who reviewed this 
section were extremely helpful. 
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dropping off after the wat and in the depression era | and then 
gr^i^ng gteadlly until 193|, during which year not quita 6,000 planes 
were built — almost 4^000 of which were for civilian use.^^^ 



World 



War 11 saw production riaa io ciose to 100,000 per year, then settling 



. down to around 10, 000 ^per, yep (Including the Korean War period). - 

' The first special tgad air .transport Tnanufacturing began in 1926 with 

(13) * ' 

' ' the Ford Tri^motor'^ - and the Tnld 1950' s the airline Industry as 

I . the major civilian customer wis well established. Since then until 

today, the industry qan be viewed as having achiavad the status of a 

• / ' ■-' - " '■ ' ^ ■ .. 

I ma^ura sector with a steady pattern of groMh and developnsent. The 

% " ' ■ ' 

- superl^osed cycles of (raillta^) activity and the growth and partial 

' ■ decline of the NASA space program since the lata 1950 's have tended 
<r to produce something of a more volatile characterist^ than for 

other mature industrial sectors. s " 

- ' -= » . '" 

/ I We might characterise the period up through 1913^ as the pre-biirth" 

; : phase; 1914^1939 as^ the introductory phase; 1940 thr&ugh the early 
^ ^\ 1950's as the transition^ phase and the late 1950's up througi 1970* 
as the climb to matu^ty; with the last few years as the bejknlng 
Of the matured phase of the industry, using the Rubenatein, Radnor ' 
Baker and McColly schema,^ ^ 



B,^ ^^ Development of the Aeronautics R/D&I Sygtem 

s \ . ' ' ' - ■ ^ 

taralleling this development of the Industry has been that of the 
aerOTautics R/D£il system* The lag in establishing an R&D base for 



*Tha date^bf the rejection in Congress of the SST program and the beginning 
of growing|airliTie concern with coats and idle capacity. 
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the aeronau^ca sector was relatively short - as can be seen by the 
early establishment of the NACA (1915)^ the forerunner 'of the present 
day NASA organization.* . 

Throughout its relatively short history the technologies of airframe 

design and materials, engine design, and materials and electronics 

have been subject to very great rates of change. These were described 

in a recent workshop on the Role of Technology in Commercial Aircraft 
(4) 

Policy Formation as a "very perishable prorepty", with even relatively 

advanced models of aircraft being phased out in seven or eight years (p, 

( 13 ) 

30), A Department of Transportation report ■ ■ (p. 8) described nine 
atages of aircraft dsvelopment from 1926 (with the Ford Trl-Motor) ' 
through 1971 (with the DC-10/L-10L4) , with each being predeced by a 
period of R&D (largaly funded by the U*S* government), Stekler 
(p*96) took note of the infcreasing role of R&D as compared to production 
as the industry developed. This degree of dependence on R&D and the 
close coupling with the maturation of the industry permits us to recog'^ 
nize that the R/D&I system hag come through the same stages of develop- 
ment as the secotr^ with little lag even at the start, and. reaching a 
point in our time when it could be viewed as totally es tab 1 ished in the 
Indus try , 

C, Ch'an_ge3 In Experimental and_Test Facil_ity Requtrements 

An additioniil factor leading to the degree of Institutionalization of 
'the aviation R/D&I system has come from the changing character of 
the experlmentnl and test facilities required. In our era, such 
work car^ only go or wlien thprc is access to very large scale facilt*^ 
tiesXwind tunnels^ f I Igh t; t facLlltleSj large computers, etc.) 
The cons e q u eh c e has 1) u en. t u c a u f r n 1 i v'. a b' u c h wor k in NA SA , the Depart-^ 
ment of Defense (DO I)) and the I £irge 'aeronaut ic8 firms - essentially 



'^The Brit Is li had set: up n siiiiiUir u J: fort ?jix yunrH enrlier (1901) at 
thu National Phy^^^^.;aI 1 ,a Ijorn u> ry , i'ht' Ciei'innn-; |)ursiK'd ;nich rotiuarch 
at this t Ima a i (lot l i n|;(jn and llic Rii!; Iruui . n t Kou tch i.uo . 



eliminating much of the diff.usad univarsity based eiforts in anything 
but the most fundamental areas (mathematical, materials and physics). 
This mirrors the similar institutionalizing effects on High Energy • 
Phypics due to the need for larger experimental facilities (acceler- 
ators) as found by Radnor^ Zaltman et al, ^^^^ 

2, Cr^tica IE vents . 

A, Creation of Federal Agencies 

The creation of NACA in 1915 was a landmark in the^ development of 
the U.S, aeronautics R/D&I system. A great deal of the central RfisD 
can be traced back to work at the Langley^ Lewis and other research 
. centers that were created by NACA and which became the sources or 
seed beds upon which the later NASA was to be built* Federal support 
for aeronautics (including civilian) has always been a major factor; 
and by the 1958 National Aeronautics and Space Act and the Federal 
Aviation Act (FAA)* of the same year^ "Cortgress made provision for 

(13) 

nonmilltary aeronautical activities thereby supplementing the 
DOD aeronautics efforts In the military sphere* The National Aero- 
nautics and Space Council was set up to coordinate related aero- 
' nautical activitlee, 

B_« Key Historical Events 

Without question the onset of World Wars I and II (and to a leaser 
degree the Korean' War) generated major impetuses in the development 
of aeronautics technology, R/D&I systems and the industry at 'large. 
Significant technical developments were pushed to accelerated fruitionj 
notably, in electronics, radar, and Jet propulsion in the World War 
JI case. The cold war acted to continue the pace of technological 
development in the military sphere. While there are Important 



^Incorporated in the Department of Transportation Act of 1966, 
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diffarenees In the needs of military versus civilian aircraft re- 
quireniants (to be discussed later) , there has at all times bended 
to be a significant degree of technology transfer t Another Important 
influence derives from the consequences of the accelerated space ^ 
program of the 1960 's (the Apollo-man-on the moon program in par- 
ticular; but not exclusively) * A 1970 event of some significance 
was the Congressional decision not to support the development of 
Supersonic Transport (SST) in competition with the Anglo-French 
Concorde and Russian Tupolev 144 SST. The recent concerns with 
the energy shortage ^ cost^ and the environment (air pollution and 
especially for noise) coming on the heels of the phasedown of 

the enormous space effort have lead to something of a revival 

of civilian-focused aeronautics Rfija as a major priority for NASA 
programs. 

Current pevelopmentg in the State of the Art 

Besides the SST efforts*, some of the current developments In the 
state of the arts concern the design of more economical and better 
performing aircraft (using NASA=developed super critical wing and 
area rule-based configuration technologies) ; the design of overall 
systems of Improved cost and safety features; and short and vertS^cal 
take-off and landing aircraft* Particularly impprtant has bten 
the roie of the airlines ^ with their own substantial R&D capabilities 
in the total design and implementation of systems into which the 
aircraft fit as one component (although -to datej the airlines lack 
similar R6tD capabilities in the equipmant design sphere) # 



*Basic rGsearch is continuing at NASA, 
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Attitudes of the Public 



An Interesting conment on the general public -s attitudes towards 
the proActs of the aeronautics R/D&I system and of the industry 
is the degree to which they are accepted with little or no question# 
New types of aircraft have been continually introduced into airline 
service with virtually immediate adoption by the ultimata users J 
indicating a faith in the quality of the R&Dj testing and evaluation, 
and control processes- 



IIl^ ^ INSTIT UTI ONAL BASE (NETWORK OF INSTITUTIONS) 

■1, The Structure of the Aviation R/D&I System 

Very evident in the R/D&I system is the extensive specialization be- 
tween institutions. Fundamental scientific research goes on in the 
universities to some degree and in NASA, which carries Research toward 
the proof of concept stage* Equipment manufacturers carry the R/D&I 
process forward through equipment development j design , te sting j and 
production stages. The airline users do no equipment R&D, restricting 
themselves to strictly dafined' implementation and utilization of .equip- 
ment in the larger overall atrline system. Even the equipment itself 
(the airplane) is specialized into major components airframe, 
engines J electronics (with even subdivisions within these systems) and 
many or most of these are subcofttracted to producers who carry on their 
otm^ R&D programs. The federal government supports the more basic re- 
search, private industry the applied work,^ 



*It is interesting to note that one of the arguments used in Congress 
to stop NASA's SST work was that in proposing to go on to a prototypo 
a t age th u y we r e encroach ing on th c pr i va t g sector role. 
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JpeciallEation goes even deeper, down to the scientists and engineers 
involved in the R&D process. For example , there are ^ole departments 
whose personnel may spend their lives on wing stress analysis. 

Additional specialization is to be seen in the roles of FAA, DOTs and 
CAB, each responsible for researching and implementing specific phases 
of the overall air-transportation system, in turn, these governmental 
institutions have' clearly defined control and regulation roles* 

- 2, The Intra^System Structures 

While the specialization is, as we noted^ very great in the aviation 
R/DW system, for the most part the work goes on in a very Limited 
variety of institutional settings. Most of what goes on in the R/D&l 
system can be found at NASA (and DOD) ; at the airframe manufacturers 
and their associated (in parallel) subcontractors; and in the u tiliza- 
tion R&D area with the airlines, with supptementary activity in DOT 
(FAA), Universities play a relatively minor role in the process. 
Figure 6 is a partial model representing these Institutions and their 
relationships , 

Thus there are three prime particlpanta in the aviation R/D6I systemi 
the basic technology sources (NASA and DOD In parallel) , the equipment 
producers, and the users. Each of these contribute specialized ele- 
ments to the R/D&I process. Except for the Indicated parallelism 



*It should be not ad that while there are other types of civilian users 
^(e.g.^ the private and corporaLo nrrcrafi: market) these tend not to be 
a mo J or fact u r in the* R. / 1) & I s y-:i tvm. 

\ 
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Figure 6 

Partial Model of the Main Ingtltutions in thg Aviation R/D&I Systeni 
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(as between airframe manufacturers and subcontractors) the system is 
highly linear; there is a well established workflow; relationships 
tend to be most intensive between institutions with adjacent R/D&I 
functions; and so on. There are no obvious gaps between functions ^ 
.although questions could be raised as to whether all of the most 
desirable linkages exist* For example ^ in some of our own research^^^ 
we noted some potential shortcomings in the degree to which the airlines 
were connected Into fJASA-a technological development in terms of their 
forward planning ^ and vice versa. The only areas of redundancy might be 
between some of the work going on in NASA/DOb and NSAS/DOT, and a federal 
committee was established to bring about necessary coordinat ion, 

3^, R/D&I Institution Characteristics 

The R/D&I system is dominated by very large institutions ^ whether 
we are referring to NASAj the major equipment manufacturers ^ or those 
airlines that play a meaningful role in tfta R/D&I process* While 
they are all highly formalized,^ their characteristics reflect their 
roles in the system* 

NASA is made up of a series of research centers, each tending to 
specialize In some aspect of space and aviation technology. Aviation 
tends to represent only a smaller part of the overall NASA mission 
and^ is of concern to only a few of the centers* Some of these centers 
are involved in the more basic aspects of aeronautics or power plants j 
others in more applied flight systems programs , NA center may have 
several thousand personnel, a large proportion of N^hom are scientists 
and engineers supported by technicians and other personnel* In their 
appearance and wbt:k istylGs these centors are university campus- likes 
but they are or g an i zed and managed in rclntivoly formal ways. In the 
technical areas ^ put sonnel= and cleparLm'.^iitri are highly specialized* 

Airfraine manuf ac tiirc.^ra ai.u f^Lructurcnl l.iku inoHt hi^'^h technology firniSj 
but re fleeting thu s[uh ial n!U/<ls of ..\ inLiijiu A^^ain Chuvt'' iti very high 
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specialization between departments which do R&D work, component design, 

systems iosigns, spacif ications 5 materials engineerings stress analysis ^ 
testing, etc, on through product ion 5 inspection, marketing , and 

so on. Airlines are structured around their roles of provWing a service 
to the ultimate customers and are supported by numerous a pplied-r esearch , 
analysis and system design groups. Manufacturers and airlines stay in 
close touch with each other at the coOTnercial and technical levels. Air- 
lines become involved In the usual market research and advertising functions 
to stay in touch with the users of their service hopefully identifying 

needs and demand. 

Final ly^ we might note that cooperationj licensing , and even joint ven^^ 
tures are quite conmion. In addition to the already mentioned subcontracting 
that goes on between the airframe manufacturers and the producers of 
engines, electronics^ etc,, it is not uncoimnon to see several firms join= 
Ing together to win a given government contract. The extensive special- 
ization in the industry craates opportunities for manufacturers which 
can be realised through cooperation. 



IV ^ GOAL S, POLICIES , STRATEGIES 

A vital initial parameter is the recognition of the size of the aero-- 

nautics R/D&I system. If we include federal funds, we are talking 

about an industry that spends something like six to seven billion dollars 

a year on combined space and aviation R&D (although only about 10% will 

be company funded). To this must be added the funds spent within NASAj 

m 

DODj etc,,, themselves. Even though. the proportion of these vast amounts 
that are devoted to civilian aeronautics is the smaller part, it is still 
a very large amount, and it is embedded in and an integral part of tlie 
largest (by far) industrial R&D system, 

•2 (i )) 
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1. Interaction Between Civilian and Military Aeronautics 

As we noted, there has been a cLpse historical interact ion between 
milltary'and civilian aeronautics. Howeverj there are substantial dif- 
ferences in the goals of the R/D&I proirams. In military RW the 
programs are oriented towards the development of complete weapons systems 
emphasising various aspects of performance (speed , maneuverability , 

hoyerlng capabilities , as well as range and carrying load) , For clvlliak 
(34) 

applications the objectives must be pointed towards li^rwamants in 

economy (usually fuel consumption) , maintenance costs (pay load) , nolSfe 
and polluctlon as well as faster cruise speed and greater range and capa- 
city,* Navertheless j there does tend to be a great deal of conmonality In 
aeronautical requirements and technical disciplines^ (p. 22), The 
tendency has been for the civilian sector to benefit thereby reduelng the 
technical risk associated with this conmercial application. In this sense, 
the military has been the field test proving ground for a great deal of 
advanced aeronautical technology going into civil aviation^ although we 
have questioned this as a trend for the future. 



2. Participants in the Civilian Aviation R/P&I System 

Turning to the specific participants in the civilian aviation R/D^I system^ 

the following pan be obsarved ^^^^(p. 47): 

"NASA addresses the development of a research and technology pro= 

gram to support and enhance the various disciplines which encompass 

civil aeronautics^ NASA also undertakes technology programs directed 

toward the solution of specific aircraft problem areas* Guidance 

is provided by the FederaL Aviation Adminis trat ion of the Depart- 
ment of Transportation (DCJT/FAA) in terms of the perception of 
the need for technology application to both categories of interest, 
the government also derives assistance in deveLoping guidance ^ 
from joint govornment Industry councils* » 

DOT/FAA pursues airway and air traffic controi techno logy ^ as well 
as airport and runway onginGGring and dGVeLopment, particularly 
as it "appl^ies to airport layout, traffic flow^ vehicle movements 
and pavement desigru'' 



*The differences may bu conLlntiiny to incruaae oh military aircraft 
take on missile capahilitiu« and charncLur i MticH * ^ 
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In addition, we could add the role of the universities which serve as 
a source of fundamental knowledge NASA and DOT atid which also per^ 
form certain contracted research from thesa agencies. Then there are 
th& industrial firms (airframe, engine and other component manufacturers) 
who do the applied development and engineering design work (airframe 
manufacturers do very little basic aeronautics research) through the 
prototype to production model stages* The objectives of these latter 
participants have already been stated in general technological and 
economics terms, 

3* R&D Within Civilian Aviation . . 

Airlines have done virtually, fio on flight equipment. Their concerns 

have centered on the utilization of equipment as part of the total air 
transportation system. Thus, airline directed R/D&I has been focused 
on aircraft maintenance, equipment schedulings traffic flows , passenger 
handling^ freight and baggage handling^ ticket reservations ^ food and 
beverage sen^lce and In- flight passenger entertainment; l,e*: with 
In^lenientatlon/utlllzation charaeterlatica * Since the 1970' a however, 
^airlines have become Increaeingly concerned with aircraft and fuel costs , 
Idle capacity, safety, envlroninental issues, etc. This concern has 
had the effect of Increasing their perception of a role In the 
rata and direction of aircraft innovation (essentially along the 
lines of more planned^ controlled and need oriented equipment programs). 
As a resu It , we have seen in the last few yearfic something of a shift 
in R/D&I goals. As we noted, up through the early 1970 'S the emphasis 
was on the development of aircraft that could fly faster, higher and 
further, and with larger pay loads at comparably costs. It was these 
criteria that spawned the SST, Recent emphases have been towards 
economy (especially in fuel), utilization characteristics , ^ environ- ' 
mental impact (with noise reduction being a major priority) and life 
cycle costs. 
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4« General 'H]^ 



Liking across the spectrum of aviation R/d4jI programs and objactlves 
wa can note that as we move from the universities thr®ugh MSA to the 
producers' and then "serj of aircraft ^ the time horizons tend to shorten, 
the oy^etivea and applications become more apecific. It ii also im- 
portant to have a Bmn&&/ of the balance between the research^ develop- 
ment, d6atin, prototymi building^ flight test, production designs and 
tooling stages. Expensive as the research may be at the MSA and. eveA 
company levels it is/ small compared with the cost of the later develop-^ 
ment arid engineerin| through tooling phases* The investments in these 
later stages can hd enormous. Nevertheless, as Stekler^^^^^ pointed 
out, the balance ^etween R&D and production Investmints has been char- 
acterized by a cotitinuQus tncreaae in role of RM, .Whether this has 
begun to plateau out remains to be seen. 
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ADMINIST^TIVE PROCESSES 




While the' aircraft industry is managed in a generally similar manner 
to moat large scale industrial firms, there^ are a number of charaeter- 
istics that are particular to this context. These characteristics 
relate to the need to manage a process that is so fundamentally R/D&I 
based; the structure of the industry (partiuularly the fact of the 
critical prime/subcontractor relationships); the enormous complexity 
of the equipment systenis; the highly codified and^ specified informatton 
and data base; the eKtent of external regulation and control; and 
the previously discussed economic and financial structure of the industry. 

These conditions have given rise to a large number of management methods 
that have come tto be known as aerospace management methods* These 
have to do with the management and control of large scale R&D pi^ojects, 
systems engineertng and management ^ simulation techniques, forecas€ing 
methods, cost/tienefit studies, reliability studies ^ contracting tech=- 
niques J logistics methods, etc* The succesi of these methods In their 
application to this industry has lead some to suggest that they might 
be more ^idely disseminated, without always recognizirtg that their 
applicablMty may be limited by the specialized context of their source* 

To attempt a complete review of the aorospace ^klministrative process 
function would require an analysis far too eKtensiye for 'this illustrative 
analysis* Instead, we will simply list here 25 specific techniques and 
concepts derived from the aerospace industry as discussed by MilllkGn 
and Morrison, ^^"^ It la to be borne in mind that their paper was written 
for the general business conununity (in the iig_r yji r d Du e i ne a b_ JlBM±(ml with 
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a view to prc^oting the possible diffusion of these techniques and 
eoncepts * ^ ? 

^1. Systems Analysis 

' 1^ ' Co^t/Ef factiveness 
3, Decision Analysis 



4 .J Hfeuristies 

5. Simulation Modeling 

6* Forecasting . 

7. Delphi ^ 

8 . Systems Engineering ' = , 

9. |eljabillty Analysis 

10, Salhtainabil tty Analysis 

11, Vtfmie Engineering 

12, Project Management 
13* Matrix Structure 

14. Govermnant /private Corpu rat ions 

15. Procurement Systems 
16* SEB Process 

Incgntlv© Contracting 

18 i. 'Contractor Performance Evaluation 

19. ManagGiTient Information Systems ^ 

20, Reporting Display Systems 
21* Scheduling/status Recording 
22. PERT/CPM . 

23 p Configuration Mnnagement 

24 # Logistics Management 

25^,- Quality Assurance 

VI, ' PERSONNEL BASE ^ ' 

Th e f I i r c r a f t 1 n d u s t r y u n ^ <5 v o r y 1 a r g o n uinb c r s u f @ c i o n 1 1 s t s a nd g n - 

g inc e r s as well a \\ o t h o r h i gh 1 y h k 1 1 1 fe d nla na |; onic n t and control p e r s o nn e 1 

1971 out of a t ( ) t a 1 . i » n ip I'O y in g ti t o f t j v c r o n c nil 1 1 i o n , 1 7 5 , 0 0 0 were 

scientists nnd (:}n|'; j noe rn (it: had betMi J)f)n higher Ln 1967) and 58,000 
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technieiatis » ^^^^ = These tend to be highly speciallged personnel^ 
and Having the pMper mix and quantity of personnel in specific areas 
is critical. Use of skills Inventories is one method of keeping on top 
of this Issue* ^ , 



the Industry is notorioua for Its ups and downs (mostly reflecting 
the shifts in military and space programs) resulting In massive hirings ^ 
and layoffp of highly skilled personnei* This can be raiileading to the 
outside observer. Thus a great deal of skilled technical work In de- 
veloping an aircraft consists of highly prograBmed detailing (e-g,, stresi 
analysis). In many ways this is production work, When large 

numbers of engineers are laid off the brunt of the cutting Is in these 
direct R&D production areas* Protected are the core R/D&I persomiel 
without whom It would be Impossible to develop future programs. Even 
for the core group there must be turnover. The high rate of obsolescence 
of skills demands a continual infusion of new blood, ^ 

Salary levels tend to be high and ther| appears to be some status 
associated with working In the industry. Naturally there is great 
mobility within the industry , as various firms wax and ^wane^wlth the 
success of their programs* 

VII, FUmiNG - • ^ ^ 

The Importance of U,S* government funding has already been mentioned 
(the government was largely responsible for supporting the R6^ that 
preceded /most of the major technological advances). Over the ten year^ 
^period of 1958-^68 5 the federal goverranent spent about $3 billion per 
year on Industrial R&D in >aerospace5 while companies were apending 

etween $1/2 to $1 billion per year of their own. funds. FitEsinmions 
of McDonnel Douglas estimated that in 1974 total U*S* aero-, 
nautlcs R&D was "down to a total of something like 10 percant of civil 
sales," This would generate something like $6 to ^8 billion in civil 

aeronautics R&D by 1985. Together this, represents an enormous Rfidb base 

, ^ . / ' , . , 

(even though most of the direct ' expenses may^ have been non'-civillan 
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.oriented.) , 

Funds from the U.S, goverTOTent that can beriefit civilian applications 
are those going to NAS^A for specific rasearch programs, and ^e inde= 
■ ■ .p^nd^n t Hgtrt^-^allo wed on .defense contracts* Corapany funds must be gen- 
eratad by sales. This has tended* to ^produce Instability for firms. 

The life cycle of , a de%|eiopment program through production up to 

first sales^can be very long. Firms must risk very large inveatinents 

In R6ID5 tooling and first production before tnuch revetiue comes in to 

repay the injfestment. The ela psed tlme_cotild easily _eKpeed_ten y ears, . 
* ■ • ' ' . 

Average rates of return tend to be somewhat below the rest of Industry, . 
Combined with the high risks 5 the sector has not proved attractive 
enough to keep all the fiteis in or attract new entries 5 resulting in 
the oligopoly situation to be found today, ^ Without governmental 
support of one sort or another, the predominant role of U,S, manu- 
facturers and the flow of Innovation would not have been possible* 

VIII. INFORMATION FLOW ' ■ 

At the basic research level (but excLuding work from the military 
sphere) the flow of InforTnatiori within the industry dMd~ be t#eeH^Yn°-^""°" '^^^^^ 
dustry and govermnent tends to be relativcsly free* "nier'e is wide ex- 
change of IdeaSj even on' an international level, with publication, lab-- 
oratory visits, etc* 5 being conmon. and hence essentially uneontroll^ble^^^ 
In the more applied development and design phases ^ in the application to 
production^ companies attempt to control information flow and to maihtain 
secrecy, 

IX, INNOVATIONS 
" , f 

The .innovations in the aviation' sector ha;^e^ very large-scale requirements. 



Direct to airlines or to Institutio^C who then lease to,, airlines , 
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Coats are enormous, especially for development, but there is a-large 
fimount of federal funding of basic and applied research^ and (through DOD 
contracta) of development. As . the innovations themselves are very cloee 
to the state of the art, there is a high level of complexity and sophis'' 
tication of technologies involved. Many highly skilled , specialised 
personnel are required. Long time spans are involved. Thus, very complex 
R/DSI systems are required. We find coordination and orcheBtration of the 
aystem being done by NASA at the research stage and by airframe manufact- 
urers at the development through implementation stages - - and coopera=- 
tive relations throughout the innovation process with aupport service 
organizations* 

From the user side of the R/D6tl process, the innovation requirements in- 
volve perf ormance/cost dmproyements and the need for the innovations to 
"fit'* Into the userJs operating system and capabilities, 

Additlona$%equirements exist in terms of' the multitude of governmental 
regulatory and control activities In relatibn to performance, safety, etc. 

The real life cycle of civilian aviation innovations is quite long - - 
indeed the older propeller planes have had very long real life cycles. 
Safety and air worthiness are the basic criteria for the limits of reaK, 
life, reguirlng a continual process of maintenance and updating of e^quip'- 
ment. While the real life is long, the competitive life in the initial ^ 
primary market Is much' shorter - - with aircraft being sold to an "after 
market" (small airlines; cargo) before the real life cycle is completed. 

The quality of the innovation is a critical element of the R/D&I process 
- - both in terms of the objedtlves of cost/performance improvefflents 
and In terms of safety and reliability factors (as already noted). Thus, 
the innovations must be (and actually are) highly testable. 

For the most part, the innovations are limited to aviation per se, but 
there is a fair degree of "spin off". Aircraft themselves can be adapted 
to a variety of applications (passenger /cargo ; long or short haul; mili^ 
tary/coOTnercial) , * . ' 

2,'/ 7 ■ ■ 
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From the parspective of transpgrtation objectives. Innovations in the 
eiviiian aviation aector have been of great benefit to society* However ^ 
we have already noted that many people are beginning to question the 
largfer costs of noise and environmental pollution | and that innovations 
have at times been '"forced" onto the airline companies . 



X* ^ NEED IDENTIFICATION 



The degree to which airline needs for flight equipment are determined 
by a complex interaction of competitive and technological forces has 
already been discussed. From this we saw that It le difficult to separate 
airframe manufacturer responsiveness to airline needs from their behavior 
in generating these needs. Thus the locus of need identification can 
be . visualized as the Intersection of ultimate consumer demand as trans- 
mitted through airline planning and. the output of the aircraft productlori 
R/D&I system. 

Airlines ffepend on market research ^ demand analysis and sophisticated 
planning fujictions to identify and translate ultimate consumer demand 
into equipment requirements ^ In the light of techno/economic/political 
conditions. These are converted into equipment operatJ.ng5 economic 
and environ^^tal requirements. Equipment producers stay in close touqh 
with thm airlines own need identification efforts but attempt to 
achieve a leadership position by translating technological opportunity 
into features that meet current ^ potential or stimulatable user needs. 
Since producers must ultimately competd for the^ airline equipment 
business (despite the oligopoly structure of the industry), something 
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of a balsjace between the airlines and the equipment producers is 
achiavad. That this balance is not always totally achieved is demonstrated 
by the recent airline exper^ience in- over = acquis it ion of wide body (jumbo) 
jets J which generated considerable over and idle capacity; and by some 
.of the apparently^ less than ethical tactics of manufacturers in their 
marketing efforts 5 which have been coming to light in recent days. 
In general, however 5 the" process tha^can be observed over many years 
has bean one of relatively smooth integration of emerging technology 
into new equipment that meets the changing patterns of consumer demand* 



XI. GENERATION/RESE^CH 

Wa. can usefully introduce this section by quoting directly from the 

American Institute of Aeronautics and Astronautics statement 

on the Design of Aircraft (p, 30): 

"Design technology^ as it relates to the field of commercial 
aircraft j is largely conceptual in nature. It constitutes the 
basis for the selection o% not only the final product Itself 5 
but also the individual components or supporting elements of 
that product. In another sense 5 it Includes the methodology 
used in realiEing the basic design concept ^ as well as the 
logical integration of the many individual elements com- 
ponentSj subsystemsj and" prpcedures into the completes^ 

=-^UHctlTOar^arfcFaFt"'iys^^ ^ - 

It is possibles of cQurse, to identify and to discuss the 
specific technological elements of the design process; e.g*, 
computer-aided structural, aeroelastic , and aerodynamic design 
methods 5 supercritical aerodynamics 5 '■winglet*' vortex dissipatorSj 
graphite-epoxy composite structural elements 5 numerically-controlled 
manufacturing processes j etc,,'* 

(& 

The above statement well Illustrates the extent to which the develop-^ 
ment and design phases of the R/D&I process depend on detailed and 
scientifically based bodies of fundamental knowledge in physics , 'fluid, 
dynamics^ structures^ materialSj; etc, , as well as in combustion.5 heat 
transfer^ electronics, and so on, for the non-airframe components. 
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This knowledge comei from basic research going qn at the .universities , 
but more substantially, at NASA and DOD and to some degree In Iti- 
dustr^s with this last sector taking on the major applied 
rasaa&ch role* Both laboratory and field research are involved, 
Diaterldli testing laboratories, enormous wind tunnels , sinnjlators 
and large scale computers combine with eKtensive flight testing of 
new concepts to provide the experimental base for the aeronautics 
parts of the field, with similar situations existing for the on 
engines and electronics, etc.. This phase of research generally 
stops short of prototype development. 



The nature of the RfiJD is such that it is often carried out by teams 
rather than individual researchers j with' many project teams reaching 
very larg&-^iEe, While creativity is important ^ (as always), progress 
more typically occurs through the accumulation of a myriad of detail 
advances in the state of the art. Really revolutionary new concepts 
have been relatively few. In the civilian\ sphere (as opposed to the 
military) publication of results at the basic research level is fast 
and open. Interstage technology transfer is achieved rapidly and 
efficiently* Even though ^ as we noted ^ much of the research goes on 
iji large mission oriented institutions (NASA, DOD, big companies), a 
very profess ional environment is maintained within well planned and 
controlled programs. NASA research centers, for example, provide, 
research environments equal to or better than that at most universities. 

R&D programs may be focused around specific applications (such as an 
SST or a vertical take off and landing j^Vl'OLj aircraft, etc), or 
around problem areas (materials,, noise, energy, pollution, speed, etc.). 
In fact, something of a matrix exists between problem and product- 
directed programs 3 with a fair degree of interchangablllty , Thus, 
Congressional action'could stop NASA's SST program but might still 
leave intact most of the applied ti<3 search that was required 
for the SST objective. Thus it is possible today for NASA to be fairly 
advanced in SST research without having had such a program** 



^The maintenance of national t^hnical readiness even without a hardware 
program^ is seen as one of NASA's missions, ' ' 

■ , 28U ■ ■ 
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■ ■ _ 
XII. DEVELOP>£ENT 

•■ # 

The realLy complex and high cost aspect of the R/D&I process is that 
whiqh goes on within the industrial firms in the transition from 
prototype to production ready and tested designs. The design phase 
is. crittcal for the success or failure of the firms in the industry. 
As we implied earlier and as Harlan^.^^^ (p , 10) has noted, design 
Is the arena of airframe manufacturer competition^ leading potentially 
to major gains or losses of market share (i.e.: a much more sensitive 
situation than that which might be founds for example^ even In the 
style conscious automobile Industry), . ^ ' 

~ — — I — ~ 

Development of the prototype is a critical stage. Where this .occurs 
is not always clear --cut, NASA typically modifies and experiments 
with aircraft as part of their research effort. At what point a new 
concept has emerged in prototype form is not always obvious^ although 
formally the butlding of production protot3rpes is the role of the man- 
ufacturers and for specific models this is clear-cut. 

Development through engineering and design processes is highly sophis- 
ticated and specialized. Numerous departments deal with component 
designs systems integration^ performance analysis. .and testing^ etc. 
The ultimate tests take place in fright test ing'r^ '^ - - ^~=- 

technology transfer is a critical element of the development function 
of the aviation R/D&I system. We have already mentioned the military-,^ 
to-civilian aspect. For example ^ the development and purchase of a ' , 
C5A transport by DOD from a given firm makes development of a civilian 
passenger aircraft of this same (wide body) type much more feasible,^" 
Similarly 3 development df a new generation of equipment by one company 
will be quickly followed by its competitors. Far more difficult are. 
attempts to transfer technology across national boundaries, as for example,^ 



_ i 

*Recent legislation forbidding prototype building on DOD contracts 
without a clear military mission may be limiting such inter =program^ 
technology transfer. 
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wh©n' companies In one country assen^le aircraft (using some local 
components and materials) designed elsewhere (such as Fokker of 
Holland assan^ling Lockheed airplanes) * Always dlfficultj this may 
be compounded by the very complexity of the aircraft systemj with its 
highly critical interdependence of materlalss design and functions and 
possibly reflecting cultural as well as economic and resource dif- 
ferences- Thus, for eKample, materials engineering became a major and 
near determining function in the effort of Israel Aircraft Industries 
to produce initially French-designed and then self -designed equipment. 

XIII. PRQDUeTIQN 



1« A Custom _Shop Process 

The production process for aircraft is more refleative of a custom shop 
working on batch orders than that which laymen visualize as the typical 
high production industrial scene. While there are production shops 
that use presseSj cutting and turning equipment, etc* 5 to produce 
components s th^ main manufacturing areas are large hangar-like spaces 
in which, a batch of aircraft are painstakingly built upj giving manu- 
facturers a fair degree o*£ fleKibility in introducing new designs, into 
the production process* The cost of tooling remains a major component 
*=of fekeYtot a investment Y"S=i nee - t-o^-^n-- imp^Mtaat -4tB%v a^h -^eWr-ai^raf t^-^^^ 
system requires the^ design and fabrication of new manufacturing, assembly 

and test tooling much of it of a very costly nature* Nevertheless, 

(13) - ' 

as was noted by DOT^" ■ (p, 58) 75% of costs are in personnel (develop- 
ment as well as production) i*e. : it is a labor intensive industry, 

2 * Con trol S y S tern s 

. ' * ^ -.. / 

The production control system la geared around the custom shop environ^ 
ment * Relatively little production is^ for stock , and most major airline 
.custonfers require variations In features* Thus^ production plans have 
to be gear.ed to specific orders and customer determined delivery schedules 
Since lead times for obtaining and manufacturing com.ponents and. for 
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the actual assembly are longs careful and detailed planning is re- 
quired , - 

3, Structure__o_£: the_ Aircr_a£t M System 

It is important to. clarify the structurp' of the aircraft manufac- 
turlng system. As Harlan ^ ^ noted ^ airframe manuf acturera "do 
not manufacture 5 in the strict sense of the wordj all the basic com- 
ponents of the planes they produce," Rather^ the airframe manufacturers 
act as the "prime" producers of the equipment and they purchase engines, 

electronics 5 etc, from other Industries %^o act as "subcontractors," 
(33) _ 

Stekler speaks of "prime contractors 5 associate prime contractors 5 

subcontractors which manufacture systems , and subsystem manufacturers*" 
In any case> the selection and control (costj schedule and quality) of 

subcontractors becomes a major pr^uction issue for the prime— airframe 

^ ^ (12,16) - ^ ■ 

manufacturers ^ * 



Quality Control 



Quality control and inspection (both in-process and fi^ai) are of 
central importance in tKe production process* Unlike most other 
productSj aircraft manufacturers cannbt ^L#£ord to correct their mis- 
takes in the field. Despite (or perhaps as Indicated by) complaints to 
the contrary (compared to almost all other secto^rs) ^ this industry can 
be seen as paying great attention to product quality and safety,. Anythini 
else would be disastrous in both social and economic terms, Thefce is 
no place for seconds* This issue becomes compounded as a source of 
problems J given the great rate of obsolescence of aircraft and the 
consequent inability to upgrade quality and design over time as part 
of the usual learning curve. Another compounding problem is the degree 
to which materials and structures are extended to the feasible extremes 
of their capabilities in consort^with the need to keep weight down to 
a minimum. 



233 
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^IV' mabketing/distribution'/dissemimtion/diffusiqn 

This feature incAdes saveral aapacts of the "bridging" function between 
knowledge producers and taiowledge users. In the civillari aviation sector, 
the primary Issue Is marketing, and we will thus limit our discussion to 
marketing, 

li Market Growth 

An important parameter for marketing ia the fact that the airline 
market (as measured, for examp^le, in~revenue passenger ^iles) has 
had a substantial and steady^ growth. Some (e.g,: Steiner ^^^^ ).have 
projected that this will continue to grow at 6-8% per year over the 
next decade, so approaching 1,000 billion revenue passenger miles by 
1985 (excluding the Coimmjnist world markets) which translates 

into a $60-80 billion aircraft sales market, 

gi ■ - 

*. ■ 

1* Individual Firms: Feast to Famine 

J 

While the gross volumes sound, and are, impressive, they must be 
evaluated in the light of their fluctuating character, particularly 
for any given firai* Given the changing 

the fact that demand may shift by Substantial degrees following tech- 
nological advances, firms may well, swing from feast to famine. Actually 
^ the military (rather than the civilian) markets have beeh thp worst or 
^ most fickle customer as far as creating conditions of volume fluctuation 
for the manufacturers* ^ / 

3, Product Positioning 

■ , y • 

The positioning of products as to capabilities^ featOes and price %* 

is critical. Different aircraft can serve different markets more or ^ 

less efficiently (or at all). Thus the type of equipment needed for 

trans-oceanic flight differs from those required for short haul Internal 
(4) . 

travel. Also, It has been stated that there is a growing 
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need for thirty to fifty passenger aircraft designed for operation in 
sh6rt haul ,citj center to city eenter markets (in respoDse to a demand 
for such service in the U,S* and even more abroad) , thus Indicating a 
market segment that may be growing at a faster rate than others. New 
equipment must be designed to fit such changing market segmentation, 

A* Predi^ct Ing/Stimulatlng Future Dejnand^ * 

This indicates the importance of knswing and being able to predict 
and/or stimulate future equipment demands from airlines at home and 
abroad. It then becomes the task of top level sales personnel to 
obtain orders^ for sufficient volume to permit the manufacturers to 
make the necessary Investmehts Into tobiing and manufacturing a new 
products thereby establishing a market (usually with one or more major 
airlines) that others will follow* As noted above ^ product ion^ wlllj 
by and la^rge, thep be tied to the specific additional orders that can 
be generated, Thfe previously discussed need for airlines to compete 
In non-price areas (through product and service differentiation)^ 
together with the matching of aircraft performance to service needs ^ 
becomes the focus qf equipment sales efforts* ThuSj close customer 
contact on a personal basis is obviously a requirement for successful 
sales efforts. The airlines attempt to capitalize on having innovations 
In equipment ^ usually bypass ignl^g^ th^^^ 

routes (where possible) anH by maximizing their publicity to promote 
their use of new equipment, (e.g.: as Pan American did with the Boeing 
707 's and 747 *s and American Airlines with the DClO's). 

ii 

5* Qbsolescent Equipment: The Af ter-^Market 

It is of interest to consider what happens to the equipment that becomes 
obsolete in this process of rapid innovation and proactive marketing. 
There is a substantial after (used) market for aircraft in secondary 
^irlin,es and cargo transportation. The ability of major airlines to ^ell 
obsolete ^ equipment has helped them to finance the Investment in new 
aircraft^ thus helping fuel thp innovation process. However, growing 
demands for such products may be offset by reductions in^quipment life 
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(of the big jeti) and increased cost and compleKity of maintenance. The 
future of the aircraft after-market and Its^ impact on the R/D&I procesa 
has still to be detarmined, . - 



6 . jtorke t plac e Cha r ac teristics 

•n- '■ . •- . " 

The economic and political charactaristics of the marketplace are 
important. As noted, there are only ^a very __f ew major airframe manu^ 
faaen^ers. The number of airlines is greater, but lA many of these casei 
(e.g#: for the. national airlines of other countries) , political and 
national economic consider at iona_cdmpate with airlirie economic factors 



in determining what is bought^ when^ and from ^om, ' Additionally, 
an airplane must meet any local legal and regulatory requirements (e.g. 
see the debate on permitting the Concorde landing rights ip the U.S.) ' 
that may be slanted to serve national interests. Also, manufacturers 
may be supported to greater or lesser degrees by their gpvertaients for 
larger economic, security or prestige reasons (e.g.i Lockheed In the 
U.S, and Rolls Royce engines in the U.K.,^ to name but two highly 
publiclEad examples.) 

Finally, it is Important to recognize that the major airlines (^e 
smaller ones tend to follow their lead) are relatively sophisticated 
customers. They are ^^11 in formed, on the operating and technolo|£car^^^" 
characteristics of the products they- buys ^nd highly skilled in their - 
implementation and utillaation. That is not to say that they do not 
,maka mistakes (a^for example with the DC7*s and Boeing 720 *s which 
turned out to be infer lo^^ to their predecessors, and the failure of 
the turbo "Compound engines ) , 

7, The Producer *s Task 



The producer's task is to^create a set of e?ondltLons (technologically, 
com.petitively 5 price ^ deliveryj and terms ^wise) that make the purcha^,^^^:^u , 
of his product the most rational decision for the airline to make 
to the polltlcalj legal and economic considerations* ,e,g*: .curi 
availability j constraints that may be operating at the tlme),^;^ 

2 86 ■ 
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ACQUISITION 



Airplanes are very expensive produetSj and^ as we notadj represent the 
major part of an airline's investment* Airplanes are also a mdjor 
determinant of their competitive capacity. That is to say^ airlines 
cannot afford to fly inferior aircraft. ThuSs deciding what to buy 
and when can be the most critical deGision an airline can make. Air- 
lines therefore make It their business to stay aware* of new developments 
from their very earliest stages ^ even ordering before tthe first pro- 
duction airplane has been eorapletedj in the hope of gaining a com- 

-pete-ifc^l ve^po s4 fcion i - The y^^r^ - e qu a 1 1 y prone to cancel orders if problems 
(performance J delivery J political or economic) appear; creating a 

very unreliable market, A maj,or continuing constraint is the ability 

.to finance the rapid and eKpensive new product introductions that may 
make obsolete their present fleets, /) 

Schiffel ^^^^ lists the following factors which he says should be taken 
Into account In making the acquisition decision: 

1) Overall demand for air transportation . / 
^ and the demand in relevdnt specific markets; 

2) Extent and character of price flexibility ' 
and competition; 

3) Price (or rate or/ fare) level and 

structure; _ - ^ - 

4) Extent and character of non^price 

competition 5 inci^uding that embodied ^ 
In 'flight equipment 5 enroute and grouhd , 
services s etcsi ^ . 

5) Extent and nature of market competition; . 

0 

6) State 'of aviation technology; 

7) Availability of investment capital; 

8) Availability of "suitable'* aircta^t ; 

9) Capital cost of f lights equipment ; ^ 

10) Operating cost of flight equipment; 

11) Exposure to risk; and, v 

12) Aircraft manufacturers ' sales policieC* 
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Equipment may be purchased because iu is seen by an airline to have an 
opt Itoal fit with its presdst route structure . However these structures 
can and do change and X\iS impact on the "fit-' may be hard to predict ^ 
sometl^eg.^leaving^ the airline with less that' optimal aircraft for their 
routes. . , ' * 



Another important CQncept is that of the "launching purchaser'^ i*e, * 
an airline that launches a new airplane by becoming Itp first acquirer 
and promoter (as did American Airlines with the DC 10^ and Pan ^^erican 
with 'the Boeing 747). This gives the airliiie the initial competitive 

/edge while absorbing the risk of iiattoduclng an innovatfionj and may 
lead to other airline adoptionSj the objective of the- manufacturer^ 

' SOTie foreign countries may^give governmeiitar support to their airlines 
to pursue such a policy j[e.g.* in France)* 

^ " ~ ■ - ' ' a , , ■ ■ - 

Acquisition decisions are crlticaL for the , airlines ^ kp^ wk pointed out 
they ar^- sophisticated buyers , even though ihi^^^s^hav^^^en made, 

^ With the ever-^creasing cd'st for equipment and the growing financial 
Constraints j'-the selection behavior has become even more analytical ^ 
displacing some of the "old boy*' network' consLderatlQris that may have 
ten^d to eKistf in the past. This need for careful analytical planning 

--ha&^becoma- jtalnfor-ced =ai^linM^^=.p^r4ticularXy=mQre^ = 
come to recognize the system-wide implications of the aircraft ^^ulsition ^ 
decision, . \ ^ , ' - - 



BglJMINtATXON MP UTILIZATION 



1. Implementation ' ^ 

A, Close 'Producer /User Coordination ' ■ . 

Implementation in it he aviation industry often begins while thp 
design is' stftl on the drawing board, T^fere is qi'oae coordllnation 
between' producers and 'Users^ to tailor the equipment to the needs. 



EKLC 



28B 



,. :m V ' - 288 - ' 

%f the airlinev Even after the model Is in general production, 
the specific order will be tailored to user daglres* How the 
airline will ufe the aircraft and the criteria that will be used , 
to Evaluate pBrformance are^well defined in advance dt implement at ion * 



B« Implement;atibn Requirements 



/ The requirements to actually implement a new aircraft are many, 

With operating features such as spee'dj . range and capacity likely to 
be changed by a new acquisition^ revisions may be needed in operations, ' 
routes, schedules^ etc. Maintenance reqiilrements and facilities 
are Mkely to be different, and will require preparation. This can 
Eostly and long process, demanding considerable pre -^planning* 
/Retraining requirements for crews and maintenance personnel can be 
very extensive. The general public may need to be prepared with / 
major promotion programs, ^ Trial runs will normally precede general 
tntroduc tion into scheduled flights* ThuSj a decision to introdjuce 
new equipment usually implies a major change on a systeii wide basis* 
While the airlines are highly skilled in carrying out Muah changes, 
new acquisitions do generate, major disruptions for aljElinM* 



C_,_ - Software Aspects 

So far our discussion has focused on the hardware aspects of the 
aircraft. At this point it is- also important- to note that there are 
software dimensions to the product that play a vital role in its ^ 

implementation and u tili^ation. The manuals, specifications books, 
parts lists j etc*, that come with an airplane are unbelievably ex- 
tensive. Complete specifications of operation, maintenance, parta^ 

,and aof^n are a vital component of an aircraft system, Without them, 

implementation would not be possible, ' ^ 



utilization 
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New equipment^ can be used to suppleme^it exist ing' aircraft in*a 
growing market,- or may be^se^ to open up new routes where this 

2S9 , 



nIs permitted and daslrable* Whan it supplants existing «Lrcraft, 



f . . these may be moved to other routes or applications or sold* In the 
af tar-market . When the change is a radical one (as was the first 
introduction of Jets in the late 1950 's) then a whole restructuring ' 
of the system is required to accbmodate the new approach* Personnel 
. and facilities need to be reoriented and changed. * 

B# _ Barriers ' * . 

. #• 

"The incentives to innovate have already been discussed* The barriers 
.are generally cost, customer acceptance and political, legal and 
regulatory constraints* There are also potential system level 
technoLoglcai constraints and barriers. For example j not all airports 
had runways that were long or strong enough to take the first gener* 
atlons of jet transports. There may be similar deficiencies in air 
traffic control capabilities. Thus it is not enough to have a 
better airplane* The airplane must be capable of being congruent 
to the systems of which it becomea ^ parts or conditidns must be ^ 
extant that permit other system features to be upgraded (build better 
runways s etc.).: Finally ^ wa are today also recognizing the extent 
to whi*ch aircraft have an important impact on our environment and 
thaf this impact must be considered as a Utilization criterion. < 

C*: Servicing and Maintenance , ^ ^ 

Once in services aircraft must be serviced and maintained (Including 
parts and components- ^placement) in a frequent , detailed and pre** 
scribed manner. > Also, from time toj/felmej changes will be incorporated 
requiring testing and approvals* Unlike most other equi^ent'V air- 
craft have tp b©^ kept' at a near-new coifflitlon at all times\ 'Pre- 
_ . ' " f * . ^ 'J' _ ^ 

ventive maintenance, a*tid replacement is the norm. Failures )-.of even 

minor eompottents relating to the operation ^of the airplane fean 
cause gpounding. Costly spares have to be inventoried in various 
locations* This all adds up to a cpstly and crl±ical aspect of * 

I 'equipment utilization* ' * 
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Since ths aircraft industry is in fact an amalgam' of gavaral in^ustrias 
: (alrfrMias anginea, aircraft alactronics, etc,) it is not really feasible 
' to diseuss aupport systams as a separate faatura* Many industrias provide 
% component s/ to aithar the prijoas or subcontraetora j and the cost ;0 building 
an airplane would ba prohibitive but for the exlfttanca of this structurei . 
of suppll/ars* Much the same could^ be said for the equlpmant (production 
and test/ing) suppliarsp and for this many brganizations, providing' services 
to alritnes* Large airlinea will ha va thft^own sarvica^ functions in 
many aBeas, Small lines can contract thesa out. Various typaa of ' 
companies have emergad specializing in the provision of various kinds , 
of sat'vices. Thus, Stekler ^^^^ notae that thara have eve^ deve loped ^ 
managj^ant companies providing systams management and^^ coordination 
sa^yices <e.g,i TRW^ Aerospace Corp*) to DOD and N4^A, 



/ 



^EVALUATION t^SEARCH 



A^ we notad, aircraft ara subject to extenslva (cbmponeht and system 
bating and evaluation through development and during and^ after pro- 
luction^^with this meticulous process. continuing into sarvice (for 
/e.quipment^usad to provida service to the public). No airplane can be V 
/ introducac into commarclal s^rvica ^ich' has not received FAA certifi- 

cation, once in service detailed records have^to be kept on flight 
; history, maintenance records, changass etc. Unusual experiances W — 
fcrashes can lead to the grounding of all aircraft of a given type. 
Vhen an anomaly or crash does occur, detailed Invastigations are made 
1 to identify the causes and to institute corractive actions as seen 
mecessary. Tha- airlines make their own^cost, relisbllity and lustomer ^ 
^response avaluations of naw.^equipment. '* ^ 
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As .wa hoted^ the clvlliitn area depended in ^the^'past on the military 

for Qonsldermfale tsehnqlogy transfer which iricluded reliability, safety 

and proof o£ eoneept data. The a|,rllnes would not ganerally buy an ... 

.alrplani that had not been flight tested by the military. With the 

divergency In needi and the changes ^in the law regarding DOD contfaets, 

this may become far less feasible and hence represent a major addsd 

cost factor « V |^ 

yix. ' RESEARGH ON R/D&I ' • ' 



We are not .aware of any previous attempt to analyze and describe the 
civilian aviation R/D&I syaten from a comprehanBlve contextual perflpective, 
This is not to say that there has not heeii much research on various 
aspectB of R/D&I In the civilian aviation sector." Obviously, much has 
been done, ms the list of references at, the end of this chapter will in- 
dicate. Thus, "we find many -studies on such aspects of civilian aviation _ 
R/D&I as the economics of the. aircraft and airlines industries 

32 33 34) ^ V. , A .,,(2. 7, 11, 13, 15, 20, 30, 31). 

jj, nature of the industry - » 

the effects of technology on economy " ' and on the industry ; 
on the technology per se^^' ^' ^' "^1 on planning and opera- 

tions^^' 16. 18, 21). 



292 



^*Re£ erencas 



Abertathyp^Wllllm J. and Waynes Kenrieth, ^"Limits of the Laarnlng Curve" 
Harvard Buslnegs Review » Sept«nber/^October 1974. , x 

^ ' ' ' ' . 4" . ■ '■- ■ * 

Aircraft Industries Assbciation, Aerospace Facts and Figures ^McOraw HiH\ 

, A-,^ : : ' - ■■■ " V ^-'-w; . - 

Alexanders .A. J. * and Nelson, J* R. , "Measuring Technological Change: 
^reraft Turbine; Engines,** Rand Corporation, Report No . R-1017-MPA/PRV 
June 1972. \ . ' ' , . 

^er lean Institute of Aeronauttcs arid Asttonautics, "The Role .of Tech- 
hology in' Coimerofal 'Aireraf t Policy Formation," New York, March* 197'5. 

Baders R. fit*, teohn, F. F, , Notoris B* R. , and Watson, R* E. , "Future % . 
Trends in Aerospace Structures," Subcommittee on Future Trends of the * 
AIAA* Technical Coamit tee on Structures, March 1974* 

Bean, Mden S,, "Fleet tlanning Procedures," Office of R and D Assess- 
ment, NSF, working paper, 1973, ^ 

Boeing Cdnrmerclal Airplane Company, "Dimensions of Airline Growth," 
May 197'4* ^ ' 

Brizendine, J- C- , "Current ^d Future Opportunities in Aeronautical 
Engineering," NASA-^University Conference on Aeronautica, Lawrence, * 
Kansas, October 23-24, 1974. . , . 

Caves, ^chard. Air Transport and Its Regulators > Harvard University, 
Press, 1962* 

Cherlngton, Paul W*', Airline Price Policy , Harvard, '1S56, - ' , ^ ^ 
Civil Aeronautics Board, Handbook of Airline Statistics ^ C^- 1973* \, 



° - ■ " ■ ■ . > ■ ■ ■ ,i - = ' . * . . . 

^ . ■ . . ^ - ^ - _ \ - ^ ^ . • =. , * 

*»" ■ . = ■ ■ = , ■ • 

12 Day ^ John S . , Sufecoatgacting Policy In the Mrfrgas Industry iarvird ' ■ * 

13 m BmpBm^umtkt of Transportation , Analysis of the United States Aero^ 

spaca and^ Air Transport Industries," March 1971. - ' \ ' 

14* ^ Gellman^ Aaron J* ,* "The Effect of Regulation on Aircraft ^olce" / ^ 

Ph*D. Dissertations MIT 1968. ' 

15* General Electric A^craft Engine Group, "Positions (or Profitable - 
^ Growth^" Financial ^alysts Meeting jEvendale, Ohlog May 29, 1974. 

16* Harlan, Neil E., Management Control in Airframe Subcontracting , % . ■ 
Harvard ^ 1956, ' - . ^ 

17* Howick, George ^^et al,) , "MD Inputs fifom Space Technology," Research// ^ ^ 
Development , XVII , ^ No . 9s September 1966. , 4 \ 

^ ' - , = ' . . ^ ' , — ^ _ ^ ^ ' . / - r . . ^ ^ - ^ 

. ■ - _ . ! i. = ■ 

18.' johnson, Walter L. (ed*). The Management of Aerospace Programs ^ - ^ 
f American Aaronaut leal Society, 1966- . u,- 

19* Millars I^* E. , and Sawers, D,, The Technical Devalopmant of Modern 
Aviation , ^raeger, 1970. ' , ' 

20. Millers ^Thomas, Styatagiea for Survival In the Aerospace Industry , - ^ 

V A, Little,/ Inc. , 1964^ ' * ' / . ' . 

21p Milliken, J* Gordorip and Morrison, Edwards J*, "Management Methods 

from Aerospace," Harvard Business Review s Marcb^-April 1973* - * . 

22. National Academy, of Sciences "Applied Science and Technological 

Progress," Committee on Science ani Astrorikuttcs , U,S,, House of ' 
Representatives, June 1967- . - 4, 



ERIC 



"X . '- -J < ' • - ■ . 

23. NelftonV) J. R. * '^d T±neon, F. S., "Reliitlng Technology to Acquisition 
. Costs: I, Air crai^ 'Turbine Engines," Rai^ Coloration, Report Ko. . 

; ... .E-aassHp]^, March 1974. • . . / .. 

24* Peck, Merton J, p and Scherer,' F* M, ^ The Waappfflj^^ Acquis tt ion Process t 

— * An Economle ^alygis . Harvard University Prase, 1962* 

' • > , ' \ ^ . . , = ^ . , ^ V 

25; Phillips, Almar In , "Air- TransporttftloA In the United States j" In 

Willie Caprqji (ed^) , TechnolQgleal Change itf Regulated 'Industries » 
Brookings, 1971 f ' ^ ^ 

26* ., . Technology and Market Structure i A_ Study of thej ^ 

^ ' Aircraft Industry , Heath, 1971.' J . 

; . 27. Radnor^ Michael^ Zaltman, Gerald ^ Kemaghms Jackp Miller, John P., . 

^ and Pipal, Thomas, "Technology and jhe Institutionalization of Science", 
' working paper. Northwestern University 1975„ 

28, Rubenatein, Albert H.^ Radnor j Michael^ Bakers No OTans^and Mc Colly, 
Johns "Some Organizational 'Fa^^tors Related to^he -Eff eg^tlveness of 
Management Science Groups In Industry", Mmag^ent Sciences , April 1967* 

29* Schiffel. Dennis* "Airline Flight Equipment Investment Decisions i 

Technology s Oligopoly^ and Regulation," NBF working paper s April 1975** 

^ ' . . ^ ' .' 

30. Schrlever,' Bernard A* j* and Selfert, William W. ^ Air Transportation - ^ 
1975 TOd Beyond , HIT Press, 1968, v ^ 

^ ^ ^ ■ * ■ ■ ^ . ■ ^ ^ ■- 

31* Simonson, G. R. (ed^). The History of the Amei^can Aircraft Industry , ^ 

MIT Ptesss 1968, ' ' . ; - 

■ ■ ■ ■ ■ I ■ 

^32, Stelner, J* E, , "The Market f or^ Conmerclal Aeroplanes^," 'Hie World 
* Aerospace* Conference, San Francisco, Calif . ,^Op^ber 1974, v " ' 



95 



- 295 



33.. Stekler.' HetBian 0. . -The Structure and Pegfomance of the Aerospacfe 



ladystiry g Unlyaraity of Calif orala Press , 1965, 



34* Strmcfordy ^an, Mr ^TranspQrc Eeonomies In the Supersonle Eta 4 
* Macsillatt, 1967* - " 



Sea also refer amoes $n the H1411ken and Morrison (1973) paper Included 
as part of this discussion. - ^ ^ 



296 



ERIC 




297 



ERIC 



- 2^9 - I \ 



m ILtUST^I^^ GROSS ■SgCTXPN^ 
C^^TIVE CQNTOXTUAL ^M^YSlfe" 



I, ENVIROH^NTS OF THE K/mi, SYSTEM \ ■ ' ^ 
m*- - HISTORICAL DE^^OPMINt ^ . 
3/ INSTITl^IONAL BME (NETWORK OF Il^tlT^ 

4, GOMiS. POLICIES^ STRATEdlES 

5, ADMINISTR4TI^ni PROCESSES \ 

6, ^ ' ^^ERSQimEL B^E 

lOTORMATION FLOW 

" ' . ■ . ^^ ■, _ . ^ r 

9, ■ .INNOVATIONS ' ' , ' ' 

10, ' ^ NEED IDENTIFICATION - ^ 

II, GENERATION/MSEARCH ^ 

12, ^ ^ , DEVELOP^NT ^ , ' ^ 

13/ ' ^ PRODtJCTION ^ - 

14, ^ ^ M^RKETING/DISTRIBUTION/DISSEmNATION/DIFFUSlON 

15., ACQUISITION ^ . 

16, ^ I^gLEI^NTATION AND UTIL IZATION / 

17. . SjPPORT SERVICES 

18. EVALUATION RESEARCH / 

19, ' RESfiARCH ON R/D&I / 



298 



CHAPTER FIVE 

' AN IlJ.USTMTICT^CROSS^SECTX)R^ 

\ ^ COIgARAtiyE CONTaCTOAL ^^ALYSIS ^ 

... ■ • - .... .. ^ , . ^ ^ ^ ' . .r^ . 

In ths previous o^a chapters » wa have lllustratad how. the CISST eon- 
textual analytical frasewprk may be used to 4esQrlbe the overall content 
for R/p^I In teo sectors; edu0atlon civilian aviation* In a later 
vqluoe^ we will provide similar illustrative contextual malyses of the 
health i the law enforsemant equipB^nt and the cwillanMndustry seotors. 

This later volume .will also^lnclude a crosa-TCctoral comparative analysi 
of R/DSI, Wiile a full crosa^sectoral consparison would be beyond the 
intended scope of this report^ there is merit In providing here some 
insight into the proc'ees^and utility of croas-sectoral coi^arative 
analysis beyond" that whjtch the reader could glean from a reading of* 
Chapters Three" and. Four (the education and civilian aviation sectors) » 

Tovprovlde such an Insight s we have choaen to predict a sunnciary o£ the 
five conteKtual' analyses to be included- in the later voli&e ^(health, 
law enforcement i civilian aviation^ education and industry). This 
sumary is presented in a table format on the following pages. .The more 
detailed discussions of the education and clvlllatf aviation sectors 
in Chapters three and Four should facilitate understandlrig of the brief 
summary context descriptions provided in this chapter* 

This chapter, then, should provide some insight intb the Bimilarities 
and differences between sectors ^- and by so doing, provide some 
insight into the process and utility of qomparatlve contextual analysis 
of R/D&I. . . 



^Further, another later volume will (as . already noted)^be devoted to a 
much more detailed contextual analysis of the education sector than 
illustrative analysis in ^Chapter .Three, ^ , ^. 
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of iquipient and 

B^jdm vs.^ lo^iil 

liiyia 
Co^pitltloQ for 

ouroii 

Role of mild 

(EilF) 

IrDduoir o| M pala 



EiytUan Aviitlon 

r 

^Econoiy^ EaintiMnOij 
noise, poUutionp 
apeid, ™p vs/ 
ailitar^ pirfomansii 

' paylsad 

KAS4/produeefi/uigrs 

Spictfui 
TWi horizen^ shorter 

Qperitlons 
Costa go yp 

Insriiilni role of M 
Clear ipiclaUaition 
fetirnll invlroWtiEal 

iffeets 

Energy 

Inviroimintil lipait 
Coats 



' Ejucatjan 
— — - — f 

■ Weak goal mtm^ 
Fidlril policy goals 

improve educatiQn 

pracilee and 'know- 

ledge 
' In, practice 
DisC-ontinuQus shiftln| 

pfioriEi^g 
Inconsistency * 
laek of intimdiiEe' 

goali 

Lack of rneehanissi to 
devolop goal eonicniui 
and'eO's goals ,: 
SQ^ by edyeational 
.fasoarch c^sLnunity " 
Hid 60's cenErai 
prograMiic Uu 
, ShsFt tise. horizon ^ 
EKternally drtini^ 
Isphadg on dEveLipiiiGnti 

paekipibli- products 
Build rigional labs 
SIE increifid enphaila 
on Iniproving pfa'ctici 
dissefflinationp iE= 
pUmtutiont uEill- 
nation bu^ldini uiir 
capabilidea 



yacfv 



Cod it^tling' primarily 
at Ehe fin ad 

i Federal apney level 
■ liphaiis in eiEher ■ ^-^^ 
case not on H^D - ■ 
pyr se, In fires^' 

. WD goals derive froa 
oprponics objeetWii 
\ Slid lArbtlni son-. ; 

^ sidiraiions 

In Ecdiral agendiyi 
on tha agoncy sission 

. and the pefcepLion of 
natienal ne^ds 

There ii no overall 
fat of Indu'^trisl 

. M polieiaj, or 

poiiey. leaking body 

' Each secf.or operitei 

through a conolix 

neEwork of int!2r= 

action of private 

organUationSj^ 

h associations and- 
^ S 

govimnianE agdncil^ 
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5i . Malfiiifaallyg Ffoeai^ 



pfefillidnal 

' ginerirtng mii 
for gfiaEif 

' forf, lafgir - 
prop'ortiqa ef 
. idBlniitradoQ 
EiiUh plidnlng 
■jliicoiini meg* 

PfQjicli riliiivily 
liiSining ^ 
ippllcabilliy of 
OS/HS techniques 
such al FEET 



- Law Infsr'ciEint ^ 
General/ tum^limlw 

-MIL ■ ■ 
iQphistieitlpn §f ad* , 

wiEh ^haraQtiriitie 
^ pf L.E. ■ ^ ■ ^ 
jrDductian/iifkgtirig/ 
. diatriSudsn. virlis 

witb brpniiilien 

tlgn/uEillzaUon/eval" 

uatjgn ' 
Less viriabiUty 
GeniriUy lewef level 
. of lophlsUcition 
Barfiir :o adpptiBii > 



" Clviligri- Aviatlan 

;.Lafgi nuiber o!^ lethedi 
- spidjkally for ■ 

iiroipace RSD; 
Imtm aay bi mi%tt 
■ relatid 



Hia Ml biiti Sfea 



Indus 



Highly devilspid tieh' 
Qlquis to diil-vilb J 
yniqua pf abliii @f 
R/pSl iyiteis . . 

lo eMercial larkalg 
th€S€ include 1 
Maikil inalyals 
Te^linkil feaiiblilty 
Pidjict sehdtlQB 
Applied r^iiaieh mi ^ 
■divilopient 
Cos!;, perfpfiaQQi 
Slandardlliaiian 
Oparaclcns wigiiiit 

Iheia indudi: 
Hon basie fiiiarch 
OgvirniinE pracidufil 
.. mttoU 

Fiipnl ihlfti of pir^ 

ionnil- 
Lpni liad liQis/ihprt , 

product llfi ^ 
Chinging §paai£iaatl@QS. 
Eiphiili oa §§fEwafi 
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i^iu::^.J2.r r:-.^;..;;-. 



i> PeriBflnsi Basi 



i 



Mi ■ 
li / 

Issi@aii6i is riim^ 
loaiud. thrdu|kat; 

lngi prapor|l6i . 
■ 'piQfiiilqaiii 
PfdfisalaQillii fouid 
it 1^ Wd K |gds 

mtitlmim kml^ 
ItHs, lipidis u-^ 



User Organkitioas 

to immiim 
idoplloa 

Cm leid t9 griaur 
libption fitii 



jivliian Avlagian 



Lafga fluibiri of Etkm^ 
mi in|ihi€rin| and 
eihar highl^ diviiapid 
ikillr " ■ 

SklU ii]£ and gancinm- 

High rail of abiohi'- 
tines of ikllls 

Siiiarch liber lavil§ 
flu^cuiti wltih 
iQonpiiii c§ndi£isn 

Miliiy hiih within 



m - 

Mil mull basa 

Congan^rited in 
riiiafchj divalop- 
sent ;|5d iviiyaiiqn 
' Inideq/aEi in dli- 

lasiftaHlsn/uiiliii^ 

Risiarih SfianciUan 

■ diflved tm SQidi- 
lie project )?yiircfi 
filher cban pfo|rii 
divalopaint 

Inadiquite lupply sf 

' Up lanagif i 




Viriei by aceEgf ac^ ' 
.cording p li^q and 
livil ol tachngloiyr " ^ 

Fadeial funding iupports 
I ■ high ratio of iciinilsts 

. and anginaars in ipaca ' 
and difanaa falatad 
indui^ryi Privaii 
fundlpi in ochar in- , 
dustriei, espaEially 
krga, risk industriii* 
oilj actor yehiclei, 
Low Eaehnology Indus* * 
ttiu hlra faw R&D 

. ^ypiSi' / 

Hl|h ipgQialiEed R^D lan- 
pQwir pools in. all lajor 
indyg^riei. Highjiaiua 
.and career oppgr lunitiai 
for pirionnel, 
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\ ips^iis - SI 
Pideril imiiui iMmt 



OS 



UtfEnfofcifflint 

pidridoptlon . 
Buipti livile and 

piQEissis iipads 
, idoptisn (budgii! 

pfiiirily kbsr- 

intinsivi) 
Fidiral funding imi* 

urn iJcpindiiutss 

by user DrpnlziUans 

jio lnoentiva% uie 
■federal funds due to 
lack of ^lisufiaci 

resulti 
Pflvaca fundi net 
tmourigef by piA 
cilved QhariQUrli 
of tbi Mrkit 



ilvlliin Aviation 



Fidaral goyirniini 
doiinani soufci 
of^K/D fundi ^ 

lidaril- J biiiien,^ 
■ a yiar 

Privite = ^ ED 1 

billiDEi 
Loni jlig jpia Ifgi 

tmml u I 
riEurn ^ 



Iducat lgn ^^ ^ ' ^ 

, ■ r~ . ' - ^ ■ ■ ■ - ■ 

'Fediral lavarniiRi 
prisiry ipgnisr 

-coneantratloB @f 
ipdnssrihip 
-i^oun^ of $ ^ 
, *dif fusion Qf:expin= ■ 
diiufis Dvir brgad 
speairui af prgjiels' 

isilkf pargeni of 
OrDii KiEionai , 
ftQim ihin ortar 



lurii inifiaiid-lDj 
<'|nnually, a|i ai i 
pirciniaiVof Giif, Im 
' ' liito 2.7. :umt 
- * dicl^ni biginalni 1966 
to praiant 
Fidaral ipindiDi la 1571^^^^ 
Ji.QI billion, gut of 
$11 J billion in Indus^ 
itiil mtQf 

Mml funding vafiis by 
mm ovaHOI inaif- 
. oraft, m in iliewical 
equlpiaat, and k^l it 
insii'uaaat iaduiEry 

«y in i^aalail and alliad 
Uimu and pitrglap 

li biiie fiiaaVih ovtr 
401 
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Uw Infgfgiiint Civilia n Aviailori 



Utml mmht^ Ryiifch lavil frit 3 lnf§fiall§n Sell devalgped natwori ^ 

uiir ini nsiarah ^ and iiiy iyaiinii of infsfpatiQn lervicis 

ilVlli I Divilepiifii/pradueUW ^ availibla and utillEidi 

liii heij. fiiiiWh ii pjoprieliry - mt *4 mt both in-houaa and ix* .■ ^ 

Umt . ■ - iKCinial M iirnaUy by iost flms > 

Diir Qf giniiiEiflBi - / ' uiii j lich firi alio ;hasi|yi- 

. iafDfial ' All weak ana iniuffidinl - tiis of propriiury, ^^ 

Fiflodliili iapprSi&l Hadia infoination 

* . / Arinual saadnp' Infofisillcn sources iri= 

■ PublieaEions ij^dg spaQiiliEid docu* v ' 

' . " Not inough infflrial nati ^ ' nsanution and Infomallon'r 

. . Each ayaiis has bafrlfers servkca supplioij 

No policy or inti^ vindorSj industfial li* " 

^ ventioni dimtid at: soclidonai tachnkal 

info-iriBifif iapiova^ publlcationij aad i 
lent; ' natwork of ixparci 



Edueadpn < Indi'strv '-^ 



^iglrt ^^" - "-^ - 

trgid tmtii 

Viriii tm iiipli 
IQ highly cDiplii 

liahnQidgicaUy . 
gdiplii ihi Is^ 
iovitldn, ihi 
idfl Ukily is 
adspslda (in 
liipr hsipiuli) 



ftoimi iuii bg dlf'- 
farptlllid .by 
funeiien yiihifl * 
Ihe lyiigs 

folici/courEs/priioai 
iori detailed ^ 

Oiabli ly 
siedid 



Oiyjliin Avii£ion 

Viiibli innovitigni., 
tind Cs in ^ 

' my largi costly 
prsdueti bui thifi 

3 in alio lany hiddia 
ifiat^Qntal liptovg'' ' 
mm to ixiitiEg 
aquipigfii and lyppoft 



Idycadgn 

Produals tha^ |d ; 

, lhrou|h a fonal 
pragiii of davilop- 

^ lin^ havs high 
divilopient costi; 
Isis expinilve fo? 

. prae^ici baiid 
diveloppinE 

"Pa§pli-chan|i" pro- 
duces - lipliea- 
- lion lot iapli- 
pnUUin (prgdugt/ 
uiir iBactlviniii) 



lanovatiBni vary froi 
liflQf changiB to njar 

■ c!)inpij' extission q! 
i^ta df artip naw 
produce with niw func* 
lion, and breakthrou|h 

Innovations incriaiinily 

^ m initlatad md di^ ^ 
velopid in corpofitloas . 

Innovation ratal la 
aoceorg Vary eonildlN 
iMy basfd en R/BSI ' 
if fort required p itati 
of am of f elf Vint. • - 
technilogiei and yaer ' ' 

. riqulriienti 
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10- Haej Idaitlh«f4fin ■ 



iiUtt 

Hild for fyiirgh 



MU IhiQ audi, 

iiplofiiloa Is 
divilaplng m 

Fe^proflE f Ifii 
esaeentfiCi on 

ysi 

FrQ^iii for siid 
idinUfieecioa la 

, surviyiii ^hi 
providiii of 

. hiilth can ind ^ 
noting ehsficui- 
liiUi of eoiiimifs^ 

Ibphails 01 ilfecd?!^ 
aesi i§ri ihia §a 



toyoae ean > 
Hot perferffled ynlforiiy 

by yiiri 
loth pfdduei iviilibllUy 

isd p^gbUii iffi§^ 

prooisi i, 
Jyt iilf-ivilmi§n by 

dipariignEi ii m\ 
Mttul priisuifii 

oflgn spark aiidB 
Bui i^mmu 

priiiurii . ' 
ffoduciri nggd idea- 

llflcition uniqug 

or spiciflc u^mt 
Lillla mMt raaaareh 

(gKcipl 7^my 

minlciiloil 
OuEiidars fljo 

10 mi idifiEllioitlon- 
uadafiUDd 

opiragloaa 



CivllUg Aviation 

ffoduggfs iliniylaEi mt 
naidi (ii wall ii ag|d 
. idaniifiemea) 
MrUnii illmiliEi ooa^ 

Aircraft closa ooaiaat 
ulCim^i publU 



MflsUy ipisodie,^ tungd 

to funding 
Scittarid throughsui 

■ Laeka foraalizaEiQa 

SiluiEian 

Opporiuniitic ' 

ItttU bcWased, 

bui incriaeln| 
^ Vary litiU mm 
latisn into *;pi§iflc 
llM raquiriBiants 

Vi|U8 sEataiinii . 

Ufiabla iQ cniEe , ' 

' intapaied'KP/KU , , 

> pirspii^ivgi 



In Eha qoiiefical 

pQnd to uiir raqueiti 
for a pod or airylce, 
or to cosipiEitiva ' 
preiiUfii .which nicis* 
iitm a prgducE gr 
iervica lipfovaifnti ^ 
They alio iinirati 
neida by diviioping 
and offering naw 
produeii of serviciai 
In lha iQvmmnt 
BUm^ neids are 
' prteariiy^idenufiid 
by tha Fidiral apniyj 
but It tiiii by tha 
fin. ■ 



lit- Seniratlan/Restaffh 



In ind indlal^ 
Hlmu 
Mil lys^ei of hgglbh 

Lib and tl^ (insriia- 

in|iy) 
Hi|h liEhnilDgy^iqulp- 

mt 

llok gf Intggfition 
i£r§ia aapints of > 
/ . thi fliid; vfiUl^y 
ll^U^a; usuilly 



Law Enfofeetngnt 
GfiaE Viflily of 

noleiy tmsfir 
wldily diipiriid 
^ ffdi^iUtafy ' 
Fidifaily fundid libi 

Mti roU for 
' linivifiiiy la hart- 



'CtvUian AyiaEldn ■ 

^ ieiinqa biiid 

Fundiiental 

Physieil loiencii 

fUnfviril!:y)i Mk^ ' i 
DOD ■ 
;'dibDratary ind^fUld' 

Larga leale^ ficiUiiUs 
leanii (Urp)' , ,V i 
AecufflulaEion of diUilad 

advingii> 
Fail publlcaUgn 
Mlyion driiniad 

ItlVifonsent 
ttoim and pr§|rai' 

mttit §f|iniiati§n . 
Risearch stopi %t 

pl^Qtg^ypl iUga, 

'j : 



Edyeailgn ^- ^. ; 

Rilativeiy ssiU 

momt of idu- 

cillsn pfieiice ■ ' 

■ii.bagid on ri^ 

siirQh; ii rathif 

son inEuUiva . 
FD&r dafinliieni-oE ' 

queitions 
Lqw rigor; inidapara 

pguiiding in clliory' 
Hilhodqlogy iiauii 
Frobtasi 

CoDpitaEion bityian 

diiciplinig ' 

DetQrniinaiiQn of ■ . 
. prisriEiai rieiivis 

'rilaEivily ; 

luppori 

Ethical ium ^ 
Mml ef riiii^eh 
lulgnoay 

Mostly flild riiagrab 
Eliiarih igvlai oui 
§f uaivirilty 



Idiasyriiinatf p^i- 
aarily in tha- RSD 
labi iirketinii or ' 
sirkat reseirch ' 
Thay ira deyelopad . . 
in Eha M lab, ^ 
lithar tHrdu|h 
siareh or raaiircK 

till af forts pradoMa-. 
ata as dois appliad 
^aiiareh ovir taiie^ 
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12. pgvilspaafit 



Dana en t^vnn patiint 
SUe if fiels 
Doni In b§ipltili 
MUn pi^lsnii ' ' 
"^fllot tilting 



DiffUuUies in m^^ 
lipgde divilopiient 
rola of 



CiviUan Avlatto 
Hl|h 

PrDEetypi 
Q^^iEicil kip 
Sat ilwa|i 
output 

dipirtiiat . 

Ends wiih fllglic 

Bigh laehnolegy 
tranifir Im 

CuUural aipBcl 



EduciUon 

(i) Use Ehe Bii|inearing 
sodel in fpmally ^ 
difinsd daviloppnt 

(b) But ht ef infomil 

(c) Fgllows fSnEai eg- 
quen^lil steps Ee . 
field 

Larp eealii iKpanslvi 
pro] lets . 

Much pfaQliee^biiid ■■ p 
devalopESntj not 
riprDus deVilopEienE 

' mid\ liEtlo field 
UsUU'\ little 
ayiEeMtig eviluation; 

^ otm riot pickagid 
for ganarili^ed uaa- 
biliiy; less axperi^ive 



Industry 

Churac^^riied by 03- 
phQ-ds 'en reduction 
of risk and uncertain^ 
ty dui to high cosEs 

. and loriE vofk eyeks; 
cost ind tii^ ovir- ■ 
runs in bsih thi' 
goyeMint ind C0i=' 
lereial mim\ ind 
pirsUelisffl and over- 
lap of prajiCE eoa- 
pononts through sche- 
duling to reduce co.^- 
pletion tii^ • 
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13.i_. Predugdoa 



^ Hialth 

as: 

1) iMnufacturlng sup* 
plm 4 equiptfliflt 

" 

2) ptovldinf Birvices 

Qtiiliey ptimvf mmn 
of produeiisn * mn 

Siveril saurces of 
quality lEandards 
and evaluation! 

1) m 

2) JepirCfflanE of 
Censie^oe 

3) Frofesslofial Stan- 
dirdi Rivley Boards 

4) terkan Hoipltal 
AsgoelaEion 



_ Law Enforgiffling 

Produeare pnirilly 
eauElQiis about 

to LE, , eipeclally 
for- innoviE ions ^ : 
: LJ, mtht alie tniy be 
suitid to iniall pro^ 
imn to mtth tin 
IMui produeEion 
fadUtiii, bi: the 
distnbuUon requite- 
henti ise^ed iniall - 
fimis dipabllmei 

Prodiictlon Standards 
net id litiportint 

Very few production 

. standards or ipgeifl- 
eat ions for fiost 

. product ariai 

Moa£ prsducers of L,E* 
innovatione are in ' 
LE* is a lecondiry 
marbt 



Clvillin Aviation 

Produstion i§ In 
cmioni'Shop invi* 
TonEint 

Produotion aontrol is 
cuiEorier oriented 
in digip adiptl* 
Elon, deUvery, etc* 

Long: Uid tlmis in* 
vol^fed In produelion 
scheduling 

Produetion of nnjof ■ 
product (airplinea) 
Invslvii one prlii 
producer h mty aub* 
contractors for sub* 
isseibliy and aub^ 
units . 

Quality eontrol of^ 
cenErll Intereit 

CotiipUcated by coni- 
plexity of prodydtlon 
and asseiiibly pfoceiiis 



Iducatloa ' 

Host.prodyceri of 
idueation producli 
are not priiaf ily 
education oriinted 
(sMlir ta L.E.j ^ ' 

Prsduetign not a iiajor 
issui iria in eda* 
cation 

Produetlsn Cipabiliilei 
(printinij m.) readily 
aviilable > 



DoainanEe of nii pfo** 
dultloa syitiis de* 
tirslnid orpniiaEios 
ind sinageiinl tich- 
nlquei throygh ^orld 
War Eaerpnce . 
of idance baaed'liigh- 
tichnolciy fini viEh 
llllCid production^ 
i^iphasis in post Ml 
r era. Unit or isall 
batch pr^cisiini tindi 
to be davelopsiat .. 
oriented; kr|e battli 



and lasisibly linej li | 
production oriinted; 
and continuous ^ 
process ing, is larkel- 
ing oriented, | 
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Eeelth Induitiy has 

no prsspacts for 
ihort^mp drops , 
in povth rat€i 

tereiaid riik-avoldanea 
aay put pester prei- 
sure en pripurehase. 

' feyting ikd evaluation 

Chanpg in goal-orienta- 
tion of iidical prictica 
itm QOff ective to 
ventive feeds biek 
produeers in fom of new 
needs ind requir^niints , 
and posiiblyj in wket* 
ing sEfaEegy 

Drug fliirkiling relies on 
pfrional.conEaet with ■ 
phyaidans by "deUil 
- usgr" 

Us^r almost ixclysivoly 
dependent ^ on produeer ■ 
for inforfflation 

Pfoducit pfQvidee both 
Ehg inforM^ion content 
and thi infomation 
disiidnaUon funeilpn 

Large hospiUli are the 
innovaEicni and 'early 
adoptin 



Markat hi|hly ffsg* 

iinled In size 

variability and 

gQal ortoaEipn ' 

of uiori 
FrapentatiQn ittipedel % 

intranci of new 

producers into 

the market 
Froduciri do mt 

(ginirally) fid it 

ecgnoniicaUy fiasiblg 

to sell oxelus^vely 

to LE. 
Many diffirent dist:ri= 

bilEion channels exlit 
Biffercnees are often 

producE-ipeciflc 
Infortiation passed on ' 

inforiaally, ospeeially 

ffgiD large to iniall 

useri 

FroQoiS no^ well insti* 

ty^ionaliged 
Riqylres considerabla 
I IniUativi on part of 

iinall users » 
Dlffuii pyrchasini proeiis 

preients fgnnldabii qom* 

pllcaelni picture to ps^ 

ten^al suppliers 
Labor inEe,niive^very sniaU 

poreenyge. of user budpt 

goes to l^uipnient 



Civilian Aviation 

Harkit is i wkUj 
ehlflctiri^ed by 
growth 

Mn relatively 
eophiitiQatid . 
cus^oairs ' ' \ 

Individuil users. 
. highly variabli , 
in adoption bi« 
havior in Ciinin|j 
■ creating flyctu* 
atlons 

Market needs segininted 
creating hangini 
needs^for Innovative 
produets 

Close custoiner eonUct 
by produeer laUs 
personnel required 
tQ generate interest 
and eoiitmltinient to 
Justify produetlon 
of innovntivQ pro* 
ducu. 

iiier qoiMitnient iiiust 
precede investniint 
in production 

Innovation adoption 
aidid by ability 
to dispor^e of function*^ 
al current producti 
wish aftef^inarkit 



' Mellon inQludiei 
dli'eislnation/dif- 
fuiion, sarkitingi 
distribution ' 

Overall iaipact on 
lyateci; weak 

All receivini cyrfent 

. inieriat by sector 
plinnira and policy 
Eskirs ' 

Disseniination activity 
shifted fros trans- 
ferriril of bodies sf 
knowledge (research 
remits) to inronsa- 
tion about packages , 
products or developed 
practicii. 

Infonnation disaeilna- 
tion aided by ERIC 
for researcher; lesp 
helpful for practl- 

^ tloner 

Fideral tundln| support* 
ed orginiEatlonS 
direotly Involved in 
infonation disseii- ■ 
nation 

Eurrent Nil intarist in 
dliseffllnation aiBied 
at yp-gradin| uier adop- 
tion behavior. Strataiy 
Ibi proactive, inter^ 
personal, yier-oriented, 
field-baa^d network 



Injuitry - 

ttoffcetini ii the focal 
point of industrial 
innovaticn. Markati 
exist in all phases 
of product lift cycle. 
In pneriij eonsytser 
markets are highly 
saturated and sub- 
ject to product Eod^ 
ificatioii and dif- 
ferintiation, not 
basic chingis, Qc- 
'casional introdyctlon 
of iiajor new products* 

Ry hig'ily sensitivi to 
larket requirements; ^ 
elaborate organiiationil 
and MBptnent tech- ^ 
niques to Insure gs 
continuous sionitoringj j 
evaluation and feed- 
backi Eiphasis on : 
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INSTITiJTIONAL BASE- WE NETOORK OF R/D€il INSTITUTIONS 



ri OVERVIEW OF THE INSTITUTIONS. BASE FE^I^ ' ' 

II. DETAILED BUB-ISSUE ANALYSIS; R/D&I SYBTEai STRUCTUHE MP INSTITU - 
TIONAL ROLES IN THE R/D&I S YSTEM " ; . 

1^ Na«ewing the Focus of Analysis: Specialisation and. 
Configuration . ^ 

2, to initial Analytical toalyeis of Specialization and 

Cenf Iguratlon ' = 

3^ Clustarlrig of r/d&IFu net ions as a Focus for Analysis . 

4, An Initial Contaxtual Analysis ot Clustarlng in Ralatlon ^ 
to Three Contextual Features . 

5, Selecting a Set of Clustering Dlmanslona and GontaKtual ^ 
.Conditions for Datallad Analysis ^ . ^ 

6^ Daveloplng a Detailed Analysis of the Clustaring Issue - ^ 

7. Scanario Case Analyses of Eniergent Cluatarlng Resulting from 
Different contextual Determinants |^ 

I, Case A' ^ 

II, Case B ^ \ 

III, Gaaa G = . 
iv. Case D 

= V* Case E . 

Vl, Case- F ■ ^ ^ nyi/> 

. . " " " - . ■ . ■ - ■ *7 

8. Initial Analyais of the Implications of Contextual Determinants \ 
of Emergent Clustering for Management/Pplicy SJ-rategles \^ 

9. Detailed Analysis of the Implication of Contextual Determinants 

of Emergent Clustering for Three Selected Areas of Management \ 
Concern ' ' > \ 
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Figure 7 - - Institutional Base (Network of Institutions) 

Figure 8 - - Examples of Intr^System Structures 

Figure 9. - - Selection of Institutional Base Sub- Issues for ' 
Focused Analysis 

Figure 10 - - Relation between R/D&I System Issue (Configuration) ^ 
Sub^Xssue (Interface) and Management Actions 

Figure 11 = - Impact of Contextual Conditions on R/D&I System 
Clustering , J* 

Figure 12 - - ConteKti^ial Determinants of Clustering Model 

Figure 13 - - Comparative Hypothetical Cases of Clustering 

Characterlatlcs as a Consequence of Varying ConteKtual 
Conditions . ^ _ 

Figure 14 - - The Use of Selected Managament Approaches in six 
coii^arative cases ^ 

Mgure 15 - - Model Relating Comparative Contextual Dimensions, 

> s_ Clustering Profile and Applicability of Jfenagement.^ 
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Clustering Sub^lsaue In Relation to Three Contextual 
Features ' % - 
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. CHAPTER SIX 

fi, _ ■ — " - - ' — 

INSTITUTIONS BABE I THE NETWORK OF R/P&I INSTITUTIONS 
I. - ' QVERVIEW OF THE INSTITUTIONAL BASE FEATURE 

A diacussion of R/D^I Institutions (I.e., the organisations In .which the 
various stages of tha R/D6eI process occur) could encompass the totality of 
Issues with which a reaaarchar or policy maker might be concerned. In our 
case, hQwaverj we use the tptallty of features lii a-conCeKtual analyses to 
provide such comprehensiveness. Thus, the Institutional base feature focuses 
In on R/D^1 system structure md process (i.e., the network of Instltutlona)^.- 
Why la it, for exmaple, that R/DSl systems exhlblt .dlf fetences In their 
structures, the type and roles of the Institutions involved In the system 
network, and the character of the relationships between the constituent 
Institutions? To be mpre specific, why do we. observe In some contexts 



a very ^extensive division of activities with considerable speclall^a^ 

tion of roles and In others we observe a much higher level of role Integra^ 

tlbn within multi-purpose Institutions? In some cases the institutions In 

the system seem to be linked together in a neat set of linear relationships, 

with each Institution being responsible for a w#ll--def ined set of steps 

withiri the R/D6I process and with these then handing programs on tq the 

next stage. ^In others we see loops, recycling, 'Institutions that combine 

idea generation and implementation yet not development, and so on. Why 

la cooperation between institutions co^on in one context but rare In 

others? It is to such Institutional network Issues tb^t this section is 

* ■ 
devoted* 

There are five malh issue areas which must be analyzed in order to gain a 
comprehensive understanding of the institutional base feature! 
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R/D&I Sygtan Initltutiong i , ■ " 

» .. ' ■ 

1# What are the rola functions of the various' institutions within 

the R/D&I syatam? 
2* What ara the characteristics of these institutions? 

/ - • ■ ' ^ ^ ^ 

R/DM System Structures i 

3* How are the R/D^I functions structurally configured (clustered) 
withinv the R/DIjI system? 

4* What are the inter-institutional linkages within thte R/DStl 
' systM? . 

5, I^at are the characteristics of structure of the R/D^l Xystem? 

Additionally, of course, we will , want to identify which institutions f orm ^ 
the institutional base of the R/D61I system. Figure 7 summarizes and 
expands these five main areas, ' ' 

In analyzing the role fimctions of the Institutions within the R/D&l system ^ 
the objective is not to^ detail the tasks performed in each of the R/D£?I 
fimctions (e.g.i the development function)* This is done In analysis of 
other features * Rather , the ob j ective is to deal with such questions as 1 
In which Institutions do we (or shoulld we) find development work going eon? 
la it in the Imowledge producing, distributing or user organizations , or in 
some combination of these (and whether in a differentiated or duplicative and 
raduadant manner)? To what extent do we find institutions specializing in 
one or .more of the R/D&I system functions (for examples see Figure 8). We 
would also wish to know which institutions are part of what we could call the 
R/D^I superordlnate system (providing system resources and constraints and 
accepting system outputs) , the R/D6I coordinate system (part of or parallel » 
to the R/D&^ system), or subordinate syatems (Institutions providllng support 

S5i 
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Figure 7 
Institutional Base 
(Network of Irtstitutidna) 



Institutions . _ - 

Institutibnal roles within the R/D&I systCT 
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Internal processes 
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Level of maturation 
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Inter-'institutional linkages 
Linkage characteristics ^ 
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Formality 

Directnass/madiatedness ' ^ 

Visibility 
Interface structure/llaiaon inechanisms 
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Open/ closed 
FiKed/variable 
Linkage consequences 

Functic/nal/dy sfunctional 
/ .V CQoperation/cQnf lict 

Joint ventures 
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Centt^alizatlon 
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Dlffuseness • . - 
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^ryless) I whethar ijastltutlons perform multi^^^ l®vel rolas (e*g* i 

providing both rasources mud support sarvices) | whether institutions are 
seetor^spannlng (providing services to several fields ^ - e.g. i 4ducation 
and haalth)| whether in a given context the Institutions are specialist or 
genarallst (with respect to R/D&I functions) * 

In analysing the characteirlstics of the institutions within the R/D&I system 
we would want to know about their Internal structures (type of configuration 
degree of cantralizatlon and formalization, etc*) 1 about their internal 
processes (decision making, commtinlcations , authority, status^ atc*)| about 
various dimensions such as st^Si leveAof maturation or davelftpmeht, etc* 



In the process of analyzing the structure of the R/D^l ' system, we will want 
to know whether the structural configuration of R/D^I functions is charac- 
terized by linearity, parallelism, looping, clusterings of R/D&I functions 
(which functions?) , Redundancy, etc. 

In the process of examining the structure of the R/D&I system^ ye will also . 
want to understand how the institutions are linked together* We would want 
to toiow ^hich institutions are liriked to which other institutions. We would 
be concerned with whether the links were srong or weak, permanent or tempo= 
rary, formal or informal, direct or meWsated,, cooperative or conflictive* 
The nature and quayty of these linkages and Interfaces, and the boundaries 
across which they occur are of central importance. 

In, .analyzing the characteristics of the R/D^I system's structures we will 
be asking such questions as i Is the system's structure centralized or f 
decentralized? To what extent is the system's stru9.ture formalized? the 
system's structure well articulated and stable throughout the system or is 
it diffuse and changlrfg? 

In Figure 8j we provide two illustrative examples of ho^^^ R/D&I system 
might be concretely structured. As these examples Indicate j we do not 
assume either that all R/D&I systems will be structured similarly or that 
all R/D&I systems are ''complete". 
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In example A, we find an Integrated producer performing all the generia 
fufictions from^ need identification through production. Marketing is 
handled by distributors (jobbers). Purchasing, implementation and utili- 
zation as well as participating in need identification and generation are* 
user Institution functions | and evaluation is carried out by an indepen^ 
dent organization (e,g, i federal government). This might describe soma 
aspects of the hospital equipment field. 

In eKample producers have only weak linkage to user needs and work only 

up to the development stage. Prototypea ^ are purchased by an organisation 

that is separate from the users. This happens, for example * when city 

governments centrally purchase for their operating units (e,g. ^ police or 

fire departments). Evaluation may be Adrtually non-^existent , In fact, 

this process describes our findings in a recent study of the innovation 

process in law enforcement equipment - - with special reference to voice 

(2) 

Identification equipment. 

We now turn to more detailed illustrations of how our contextual analytical 
framework can be utilised in relation to various feature issues, ^ To do this, 
we have narrowed the focus of our analysis by selecting sub-Issues from among 
the list of Issues in Figure 7 . 

II. DETAILED SUB-ISSUE ANALYSIS: R/D&I SYSTEM STRUCTURE ^ 
AND INSTITUTIONAL ROLES IN THE R/D&I SYSWM 



1, Narrowinfi the Focus of Analyaig: Specialization and Configuration 

In this detailed sub-issue analysis, we have chosen, to focua on the R/D&I 
functions. To sharpen this focus furtlierj we have selected two sub-lssues; 
specialization of institutions (with respect to the R/D&I^ functions) in 
relation to the , emDrncnt structural configuration of the R/D&I s ystem (in 
teriis of the R/D&T functions). In the "conf iBuration" sub-issue we are 
specifically interested in how the R/D&I function^ are clustered (i.c,. 
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EavirOnmqnE of the R/D&I SysEem 
Hlitorlcal Development 
^ [^natlfcutlonal Base (Netwcrl^Qf Ing Cl tutiong)~ | 
Goals^ policies^ Strategies 
Administrative Prbcesiee 
PersAnel Base 
Fondlng 

Information Flow 

InnQvatlona 

Nead Identification 

Generation/ Research 

Development 

Production 

Markg ting/Dls t ributlon/Dl^ seisin a tion/Dlf fusion 
Aequieition 

ImplemGntatlon/Ut nidation 
lupport Services 
Evaluation Research 
Research on R/D5il 



Institutional Base (Network of Institutions) 



7 Institutions 



Institutional roles in the il/D&I systeu? 



SpociAligation of institutione 



Role in superord Inate/eoordina t e/raibordlnate Eiye tarns 
See tor- spanning ins tl tut ions 

Institutional Choracterloc Ics 



System Structure 



^ System Configuration (c luotci Ing) of R/D&I Functions 



inter^Ins t i tutionnl Llnkagd 
C h a r a c t u r i Li 1 1 c h 



Figurei 9 



S_QlGction of InBtlUutlonal Basg Subtle bug s for Foe used Anaiyaig 
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grouped together) In the, various Institutions, This dual pferspactive 
(specialization and configuration) of the Institutional base of the R/D61I 
functions should provide a rich base for analysis* The process for 
narrowing the focus of the analysis to these two sub^isflues is illustrated 
in Figure 9. 

' 2* to Initial .toalytlcal Analysis of Specialization and Conf lgura_ti_Qn 

_____ 

We are now ready to begin our first attempt at contextual analysis for the 
Institutional base (network of Institutions) feature of the R/D&I context. 
The question at this point Isi Do we observe , (as we look across varlDus 
contexts) differences in the way that institutions operating In the R/D&I 
system specialize In various R/'D&l functions (from, n^ed identification to 
utilization and evaluation research) and In the way In which these R/D^I 
functions become clustered in the emergent configuration of the R/D^I 
system? This is shown in Matrlk i in which the apeclalization and con= 
figuration variables are interacted with each of the contextual features. 

As always J there are interaction effects between the various futures in 
terms of their impact ^ as well as second order issues. For example ^ Matrix 
1 enumerates a whole complex of contextual requirements which will lead 
to the configuration of the system network taking the particular form that 
it might i,n any specific case (thereby moderating the generic requirements). 
But the emergent configuration itself, immediately and over timej generate 
a source of continuing variance. Thus the configuration may generate inter- 
face issues requiring management and policy actions^ Depending on how these 
management and policy options are exercised, there will be a feedback 
influence on the configuration of the system. One example would be the 
creation of liaison mechanisms to help overcome interface problema and 
sometimes leading to the appearance of actual liaison institutions in the 
network of institutions* .Another examjile has been the emergence of business 
incubator departments and organ! zationa whose specific role is to overconiG 
the interface dlf f Ic^fflties that are common in the R&D to commercialization 
linkage- This generul issuu Is diagraminod in l igure iO, 
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Inititutionalizatlon 
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Interf aca 
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Figure 10 . ^ ^ 

RelatlQn_^atjmen R/Bj&I System Issue (Configuration ) , - i 
Sub -Is sue (Interface): and Managemen^. Actions^ \ . 



Anothar interactioh effect of aome relevence is that between technology and 

Institutionalization (i.e., relating the environmental and historical features) 

(3 ) , 
In some of our own rejcant research ^e have. demonstrated how an increase in 

tl^e^ scale and investment ^In experimental technology can act to further the in- 
stitutionalization of a field of science (in that c^se high energy physics) 
defined in terms of its industrialization, bureaucratization and shifts in' 
professional norms from cosmopolitan to local values. Such phenomena would » 
be related to the ^'technological imperativev and '^sunk cost" effects already 
noted in l^Iatrlx 1. By such concepts we refer to the hypotheses which %ee 
scientific 'choices and speC'lalizations as being driven by the demands of the 
la^place technologies of experimentation* whether by its Inherent constraiiits- 
^or.by philosophies requiring explod^tatiCTp (and/or amortization) of previous 
investments In technological facilitleLj and equlpmBrit: , 



Returning to the MatriK 1, it i^ evident, that the historical and environ- 
mental features of context would^ be a starting point of' rich potential. 
Examination of the issues to be found in these areas Indicates the 
centrality of such questions as the nature of the stdte of the arts and the 
legal/eoonomic/soclal noms. In the light of our Miscussion above corfcem^ 
ing specific ihcerdependencies between features ^ it would therefore appear 
-necessary to connect any -consideration of the impact of historical and 
environmental context on specialization and configuration with a confiidera-^ 
tioA of .the professional skills and norms of the personnel involved in the 
process* ^e question of skills required for, specialization can be seen to 
be a pervasive issue in this analysis/ In selecting ^ therefore ^ a narrower 
area for comparative analysis we focus in on the subset of Matrix 1 area 
represented by the above features* 

Cluatering of R/D&I Functions as a Focus for Analysis 

Further,, as anqther simplifying step in the analysis \t would be helpful 
to attempt to link the twiti dependent variables of spacialization and con^igu 
ration, ^ The question is * How do various patterns of special i Eat ion reflect 
theAselves in the c p n £ 1 gu ratipn patterns of R/D&I systams? Another way of 
-Ma*^tng-t=h4s--qu@a^ti&n^4sf--' HaW' do-the various -speei^^tia^Jfciust^r^^ogethex^""^ 
within specific institutions in the R/D&I natworkj hence genetatirig the 
emergent configuration? In practice, of course, we do not encounter a 
near infinite variety of institutional f^rms each with its own cluster of 
specialtias* For most practical purposaa the clustering with which*we 
are concarned^s at the mora macro level of the R/D&I ^functions that wg , 
(and most others) have described as, '^development" , ^production'- , ate/ - - 
although it i^Pto be boma in mind that a specific specialty that is to be 
found in "research" in one ^context may well be found in "devalopmant" or 
"implementation" in another; Howeverj for our purposas, at laast in a first 
analysis. 3 it is reasonable to concantrata on the question of how .the R/D&I 
system functions are grouped together (clustered) in the network of insti— 
tutions * '"Clustering" is an^ issue that captur.es much of; tHe specia 
tion issue. It now becomes the focus of our continued an^^^Ws * - % 



369 



346 - 



IttTRIX 2 



Initial De tailing of Quest Ions Relevant to the Clus taring 
Sub=Is8we in Relation to Three Contextual Features 



ConteKtual Faatura 



Clus taring 



J . Environment 



Political/Legal 



Are thare any political/legal detar- 
minante of clustering of R/BStl functions 
(e.g* % legal requirements that basic 
research must be controllad by prfafes-- 
sional practitioners, i,e,, professional 
regulation)? 



Economic Factors 



Scientific/Technological 
Factbra ; 



Has there been any pattern of economic 
support that has parmitted certain 
R/D6fl Institutions to grow and absorb^ 
functions previously par formed else^ 
whare (or not a^; all)? Has the Qver- 
all level of economic support permitted 
the full development o& R/D&l system 
functloris? ^H^ve tl^e sotirces of economic 
support legislated the ciustefing of 
-functions - J or r easo ns - o f --ecoBomlc—a^^-— 
trol and cos^ef f iciancy^? 



How doea the nature of the knowledge 
base (state of arts) defiermine the 
emergent clustering patterns (e.gi, the 
ef f ect ^of the ability to cddify \h^ 
taowledge on Interface transfer dif'- 
flculty)? Does increasing certainty 
of toowledge permit greater speciali- 

^zation? Are craft (as opposed to 
science) fields more or less likely 
to exhibit detailed specialization and 
differentiation of R/p^I system func- 
tions into separate institutions? What 

g types of technology provide opportunities 
for ^economics o£ scale* and how does this 
weigh against lAfcerface costs in de^ 
teminlng functional clustering? 
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Historical Pavelopment 
Institutionalization 



Critical Events: 
Political 



State of the Art 



Legal/ 



Time Effects 



What is the relationship between the ^ 
level of institutionalization of an 
R/D&I system arid the way In which R/D^I . 
functional specialties are clustered in 
specific institutions? Is there a ten- 
dency towards more specialisation with 
maturation? What is the effect of ln= 
stitutionallzation on the evaluation 
process? 

Havecthere been any specific legal/ 
political events requiring (or for- 
bidding) specific clusters of functional 
specialties? 

Have there beftn any state of the art 
developments that have significantly 
modified the nature of the various 
R/D&X system functions and hence how 
they are clusteifed together In insti-* 
tutlons? 

How has any gradual change in the nature 
of the fields of knowledge influenced 
the way the specialties operate and in- , 
terrelate between each other (for example 
through increasing codification of the 
knowledge base) ? ^ Have patterns of co-^ 
operation emerged over time? What is 
the imp&ct of institutional growth and 
decline on, the clustering of R/D&I 
ays-t^.m=-funat4=^on&2 ^=_„. . .._„^ 



Personnel Base 



How do professional norms ^ career pat^ 
terns , etc ^ determine the combinations 
of specialties that are found in^ the 
field with consequent Impact on the 
clustaring of R/D&I ' functions (e.gs 
do the ns%rs insist on participating 
and even controlling the knowledge gen-, 
eration process)? How is the flow of 
personnel into and out of fields af-- 
feccing the viability of specific ^ 
institutions and hence the clustering? * 
What is the effect of differential 
obsolescence of personnel in various 
fields? What is the effect of personnel 
in some parts of the R/D&.I system being 
only partially cotmnitted to their spe- 
cific functional roles (a*g* : part- 
timars or having multi^f unctipn con-^ 
cerns)?' 
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4. An Initial ConteKtual Analyslg of Clustajrlng in Relation to Three 



Contextual Features 



Matrix 2 develops our analysis around the focal issue of clustering. In 
Matrix 2,^ we become somewhat more specific on the issues than in Matrix 1 
but we now concentrate only on the historical development i environment and 
personnel base features of the context as they impact the clustering of 
R/D&I functions. 

Examination of Matrix ^2 would indicate that the three contextual features 
(environment, historical development and personnel base) are being operation 

alized under a number of main areas. These could ba donsolidated as followfe 

1. Effect of the institutionalization of the field of knowledge and 
knowledge application, 

2* Legal/poHtieal /social/economic regulation ^ 

3* Political/social/economic support for various institutions and 



functions * 



Ef f e efr = o f= - 4 eeh n o-l o gy 



Nature of the knowledge base (state of the art) . 



Effect of the maturation of specialties. 




Professional characteristics of personnel* 



the above could be consolidated further Into issues concerning: 



1. field of knowle^O and application (items 1 and 2); 





R/D&I institutions (3 and 4) ; 
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3. ■ functions (3 and 4); 



'4. knowledge baaa (5 and 6) ; and 



5. personnel (7) 



Further^ a raview of Matrix 2 reveals the Implicit model diagratmied In Figure 
below p ^ ^ ^ 



Contextual 

Conditions 
/ Historical 
Environmental 
Personnel Base 

I 



C Operationalized 
as tha consequencas 
on the: ) 



Nature oft 
Field 

Institutions 
R/D & I Functions 
Knowladga Base 
Personnel 



^ Clustering 
Issues In 
the R/D^I 
System 



Generic 
Clustering 
Issues 



R/D&I 



Impact of Contextual Conditions on R/D&I System Clustering 



The dependent variable (the clustering of R/D&I functions into institutions), 
is relatively simple in this case. We are concerned with how the generic 
R/D&I functions are translated into sets of ^ctivitiep being performed in 
the various real institutions of a concrete R/D&C system* Soma of the 
specific sub-issues would be^ ' 
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How niuch speclallgatton do we find within R/D&I functions? 

Tq what eKtent do we find sevei^l R/D&I functions clustered together 
in single institutions or institutional arrangements (cooperation)? gr 

In what function location in the R/D&I system (at knowledge generation^ 
production^ knowledge utlllgatlonj etc*) do we observe any such 
clustering? 

Do the clusters tend to occpr by the joining of contiguous or 
adjacent R/D&I functions or of loo^e^ (non adjacent) R/D&I functions? 
Are the clusters linked In serial or parallel networks? 

Do we observe gaps in that nowhere does a given R/D&I function seem 
to be fully carried out? ' ■ . 

Is the observed clustering stable or temporary ? 

7* riow forroal and vis Ible is the observed clustering? 

8, To what eKtent is it legally and socially sanctioned? 

5. Selecting a Set of Clustering Dimensions and Contextual Conditions for 

Detailed Analysis 

- - - ^ 

Matrix 3 takes our analysis a step further by relating the above dimenaions 
of clustering to the previously discussed conteKtual conditions* However^ 
while Matrix 3 in its entirety is a franiework that would be' proper for a full 
analysis of a specific case^ It is still too large and requires too specific 
a level of knowledge to be useful for a general illustrative analysis. Specific 
events, regulations , etc, would be of great iinportance in a given case but 
cannot he generaliEed for. useful presentation. It becomes necessary for us 
to further simplify Matrix 3. 




Professioifalism of 
Petionnil Base 



Matrix 3. Contextuil AMlysls of Clustering of lIUl Functions 



We can do this by fi^rst selecting a subset of dimensions of clustering which 
we will examine. These at mi 



1, 



specialization levels; 



the eKtent to which clustering of R/D&I functions takes place; 



3. 



whether the clusters are of contiguous or looped R/D&I functions 



(i.e. J level of contiguousness) ; 

4s the degree to which gaps (in R/D&I functions) are to be found in 
R/D6el systems. : 

Secondly, we can also elect to eKamine^a set of contextual conditions thitt 
captures several critical dimensions but not all the richness. Thus we can 
look at time effects in terms of the impact on both the system and the 
'^'ffi^^^atlon of specific specialties. Therefore , we shall use the idea of the 
Institutionalization of the field to denote such effects on both the system 
and individual special ties^ Support and regulation are often interrelated 
and hdve an enormous variety of possible aspects In terms-of who, how, when, 
why, etc. For illustrative purposes we will limit ourselves to^a simpler 
_ls s,u^^_ ^ n amgj.^ Dp.es_ s up p_g_r Jt ^ and^bx _ r e^ u 1 at Ion in the s^ s t em come from the 
producers or, users of knowledge and products? Stated in this way, the issue 
also allows incorporation of an Important aspect of the prof essionalism con^ 
dition; I.e., whether the dominant professionals in the system are to be 
found in the producer or user functions or both (l,e,, where they exert 
controls) . Technology will be considered only in terms of the effects of 
economies of scale- The Icnowledge base 5^111 be considered only in te^s of 
its level of certainty (including notions of science vs p craft). 

The^intersection of the selected subsets of clustering dlmensioirrg and 
contextual conditions are reflected in the shaded columns in Matrix 3. 
This is not to imply that the other clusterings dimensions and contextual 
conditions are not important, but ratherv that those selected do permit a 
useful first level of illustrative analysis amd insight, and capture well 




the two original aspects of specialization and conf iiuratlon. 



6, Developing a' Detailed Analysis of the Clustering Issue 



We can now ref oimilate Matrix 3' Into Its ^simplified form as in Matrix 4, 
The ''x's" in the calls represent hypothesized relationships between the 
axpected type of clustering and the selected conteKtual conditions. Those 
cells for which no relatioaships have been indicated cannot be predicted by 
the individual contextual variables alone. The iimitations of two variable 
propositions is also recognized. It Is our assumption that such analyses 
are but a first step in an enrichment process perTnltting the construction of 
more elaborate theories and models at each step of the asalyslSj as" is found 
necessary and useful. 
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Knowledge Base 
Certainty High 


X 
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(Sci/Craft) Low 
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X 





MatriK 4. Selacted Dimensions of Clustering as bete^rniined 
. bv_ Selected Contextual Conditions . 



Matrix 4 can also be presented in the form of the model as shown in Figure 11, 
'A complete discussion of this model and the adraittedly^ebat able' relationships 
Indicated would be beyond the scope of this study; and, the final analysis , 
validation and modification will have to await empirical testing. It Is a 
poignent coiittnentaAy that the literature has not to date focused attention on 
the compleK of variables in Matrix. 4 and .Figure 12. 
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Other 
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Figure 12. 

Contaxtual Determinants of Clustering Model 



For now wa can argue that as institutionalization progresses, there wil4 be 
a tendency for specialisation to grow as tasks become learned ^d as H^rogrammed 
procedures and associated facilttles are developed, thareby facilitating the 
division of activities. Further, as specialties mature over time there is 
a tendency for sub'Speclaltles to crystaliza, even eventually leading to new 
specialties and disciplines. Increasing economies of scale make specialization 
mora efficient. Increased certainty of knowladge facilitates and stimulates 
specialization by permitting codification and easier stage-to^staga ^transfer . 
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As user power (in the forms of support and regulation) grows iri the syst^(^ 
we might expect to ind users exercising control bvar- more R/D${ I "functions 
in the system = = resulting in larger clusters of such functions • Economies 
of scale tend ^to genarate the larger institutions that can exploit these 
opportunities s and they ^ in turns are able to absorb associateS R/D4I 
, functloniSi thereby reducing technology transf er>Gosts and supporting the 
large scale operations* On the other hand a more certain toowledge base 
makes it lass vital that interdependent R/D&I functions ^operate out of the 
same institution. 

The previously mentioned issue of increasing user power would tend' to gene^ 
rate looping rather than contiguous clusters as users reached into the -need 
^ identification and idea generation stages* A more certain knowledge bases 
would facilitate interstage technology transfers but the concurrent special- 
ization would tend to stimulate a step--by-step linkage process*. Similarly^ 
interstage gaps would tend to become filled , especially as the field became 
more institutionallEed, 

The model in Figure 12 indicates another important aspect, namely the inter- 
depandance between the contextual cunditions^ Thus tha type of regulation 
will tend to.be related to the level oj institutidnaliEat ton as well as the 
extent to which aconomies of scale become^^eK^lqi_teAi__to^ t_ha.:^r3.te af=.-^._. 

ins titutionalisation will be partially determinad by the problams ganeratad 
by the uncertainty of the knowladge base; and so on, 

The above discussion can also be presented in^the form of a sarias of propo-- 
sitions 

# fc. , 

Proposition 1. -The more institutionalized a field is (iia., the more 
f ormalizad , stable and matura are its institutions a'hd 
specialties) 5 tha greater the specialization of actlvl-- 
ties and the f awar the ^functional gaps in the system* 
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Proposition 2* The more that regulation and support (legal 5 social p 

political and .economic) is determined by the users (as 
^ opposed to producers) , the. greater the extant to which 
, ' ^ ., R/D&I functions are clustered into specific, iAstitu= 

tions and the more likely are we to find such clusters 
taking the form of non-linear loops- ^ . 

• ' r ■ ^ 

Proposition 3. The more the technology, creates economy of scale op= ^ 
portunities and requirements 3 thi highef the level ofj 
specialization and the more cluptered are the ^various 
R/D&I functions in specific. Institutions , . ^ 

Proposition 4. The less certain (i . e . ^ craft- like) the knowledge ^base: 

a) the lower the level of specialization; 

b) the greater the number of functions to.be found 
y ' clustered into institutions; 

c) the less likely it is .that these functions' represent' 
adjacent stages, in the R/D&I systems model; and 

d) the more likely it Is that there will be functional 
" . gaps. ' * - ^ ^ - 

The"mbdel in Figure^^lT ars"o"pdtrit^^^t"o m ^^nfftd^rarton-; =ttatttely™tfee- — ^ 

indication that the four selected contextual conditions, while potentially 
very Important, are not' the only determinants of the clustering dimensions/ 
Thus, the level of institutionalization of the system and the level of certainty 
of the knowledge base contribute to but are surely not the exclusive determin- 
ants of the appearance of gaps. In this case we are dealing with a variable 
that can be changed by deliberate and direct policy and management action. 
We can act to .fill the gaps that tend^o emerge in the given conditions, 

A further review of the relationships in these propositions and the.mpdel in 
Figure 12 indicates four additional considerations. 
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1, The relatlonshtps are uni-directlonal. Thr Itvel of certainty 
of tha knowladge indeei*^ helps to determine the extant of gaps 
in tha R/D^I system, iut a change made by flliing these gaps will 
not, at .deast^directly, have any impact on the nature of the know- 
ledge base. ' 
' ; ' " ■ .. ' ; . . * , * 

.■ 2* The contextual conditions (which are the independent variables) are ^ 
asaentlally non=manipulable ^ at least in th& short run. The ' 
econotflic^ of scale are there or they are not* 

3* These independent variables can vary oVer a wide range (e.g.: from 
very hl^h to very low levels of institutionalization) and at this' 
_ point, we have no measures of their ^^arameters or relative i(?eights 

^ . * In the rerlationshipa • . . . 

4. There are also a great number of cbtnbinatlons that, are possible ^ 
^ between the variables, and (as we noted^ earlier) there may be other ' 
determinant^ of the dependent clustering conditions. It is there- 
fore not possible to take^ a given c^lustering configuration and 
identify a unique conteKtual condiltion that produced it, 
■ ■ '- ■ ■ J . - ■ ^ ^ ' ' ' ' ' ' 

^"^Wlt^^'tHeTe^'fdar^'fac^trrr^^^ ^ttTarrttll^^^utlllc^'^'d'f tlTr^mnd^l^-— - ---- 

must come from its eKplanatory rather than its mariipulatory pdwer, lAwe ^ ' 
'"can better understand why a given R/D&I systemlhas the clustering (b^r more 
broadly J . configuration) that it do^s^ then we can avo^ld/ attempts to build or 
retain Inappropriate s^jstem ' structures , Furthermores we can determine policy 
^ options and martagerial strategies that are properly ^adapted to the funda- . ' 
mental constraints of- the ^context ^ rather than working at cross ^purpoaes with 
its natural cKarae terist Ics . ^ ^" 

, We could pursue two different analysis str^^eglea from this point. One. " . . 

* ' - . - ■ - ' '■ ^' ' ' 

would be ,to search, both .dedi=^tlvely aftd" inductively, for other determinants 

of the clustering dimensions* This would undoubtedly be productive and 

' fascinating^-^ and could lead to a' 'tlch. .theoretical understanding of the issue 

with* important potential policy^ implications , It would however depart from 

the ^cope of this limit ad illustra^tva' ahalys'is . ^ ' ' , 

■ . ■ ^ - \ ' # ■ ^ ' 3B2 . 
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A sSicei^ and boife liolt^ sti^agy la t© foHo^the partial in^lications of j^ 
fefatioua' eonfigurafcLoni of contextual determinants Into the 'Emergent clustering 
and then ,on toi the.^atiagerlal and policy strategies that wpyld seem to be 
congruent with that emergent co'hfiguratlon, given these antecedeht conteKtual^ 

conditions*^. We will^uraue this latter approach, , ' 

■■■ = ■ ^ ' ■ . ' • ■ ' ' ^. ■ "■'^ ■ ' ^- ■■* 

7* 4 Scenario Case Arialyaes of Emergent Clustering Resulting from Different 

Conte xtual Determinants ' - . ^ 

— ^ — ^ ~ — ^—V^^. '^^^ .. ■ ■ , - ' 

. As a first step let us examine a number of hypothetical yet realistic case 
altarnatives in which we will astabllsh conte^tnal ptof ties and ''derivte-' the^ 
emergent clustering. ^^Since it Is our objective^ here to be illuitratlve 
rather than >£d make a more formal cross sectoral ^cDmparative^ ahalys is we wiir 
limit ourselyiss to a relatively ' casual livel-df linkage Into actual real 
world situations. Thus, we wtll for now need to do a minimum level of such 
imWrng to Illustrate our^^olnts* We m\ist alio relterkte the points noted 
abovei wie do not know the appropriate weighting of effects acrdss the 'con- 
textual features nor do we imp'ly that these^ are the dnfy variables Influenclrig 
the emergent cluster. Thus the following ana^lys is should be ^derstobd as 
an examination of partial effects that would tend (although^^ would expect 
significantly) t*o influence the observed clustering in apprc*imate^ 
"derived" direction* We will then go on to discuss the inapffiLcatlons in each 
case for management strategies* These cases are shown in Figure, 12, 

* F ... 

A simple analysis method has been used, A s^ple rating fyst'em (from very 

high ' to very low an4 using equal intervals) was . set Op for e^h contextual . 
condition and the' relative weighting across variables wat assumed to be i 
equal'. This latter ass^mptio^ appears as reasonable as any other at this 
time-artd would need to await Empirical investigation to ^e modified, A 
sauries of h3fpothetical case examples (A through F) were set up and the net ^ 
^scores .for eacli of the clustering dimensions was ealculated^(using% the 
"relationships In^eated in the model in Figure 12 and simple arithmetic 
computation). These net scores were converted back to a very high't^ very 
low scale according to t^e table shown (which allows 'for the/ fact thtft some . 
of the clustering dimensions are influenced by two. and some by three con- 
textual variables) , The resultant (or hypothesized) dimerisions of' 
clustering 'arfe indicated in each case in Figure^ 13* ' ; 
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Buesto the possible rarige of ratings and the varying number qf Independent 
variables i the ranges aeroes eluaterlng dlmensiona will vkry. The follow^ 
Ingf oonversion table has been used. . ' " . 
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C gpparatlve Hypothetical Cases-^^a^ Clustering Characteristics 
as jL'^Corisequenca of Varying ConteKtual CQnditiQna 
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We must recalL our previous cautions. The indicated clustiBring diicyensloM 

ckn qnly^be considered Indicative and illu'strstive^but can, we we will now 

' ■ ' ■ ■ " ■ - ■ . ' . ^ . '.- ^ : . . ' „ 

demonatrate s provide some provocative insights * 



Case A ^ . \ ' ' 



CAp^B A and B represent the two extremes* In Case A we see what we-'^aould 
t^vm a hlgh'ly underdeveloped R/Dfisl conteKt* The sys^tem has riot prociteded 
iar in becQming institutionaliEed* The knowledge producers lack any control 
,lind regulation rfOver the systeraj no economics of scale have developed in a 
eraft-^llke fie^d (i.e*, a field with a highly uncertain knowledge^^ase) . 
While undoubtedly exaggerating in some aspects (particularly as :r€ga the 
extremes of low institutionalization and user control) one cannot ; but help . 
thinking that the educational R/DSfl system until very recently almost fit < 
this descr^^ption. (Though as we ^111 notej Case E perhaps more closely 
.reflects l^Le educational R/D&'I system). The crimtnology aspects of the law 
enforceme ^t R/D6il system klso might almost be included in this category* 



If we mov>^ down Figure 13 to examine the implications for the R/D6eI system 
^clusterinji for Case A we would be hypotheai^ing a very low level of' special- 
nation tj'ut a very high degree of clustering together of R/D&I functions 
nto a eorisequently small numter of institutions^ However, these institu- 
ions woiild Kot be involved in sets of ajacent roles from basic research ^ 
hfough d,ivelppment through production to idiplementation ^ etc. - but 
wpulA rather :end to unite c ombijia t i ons of (for example) development and 
utilization (qr even basic research and utilization) ; or development, 
marketing and evaluation research; and so on ^-^ and importantly, would be 
leaving many R/D&I afunctional areas virtually undealt with (i,e*, there 
wbiild be many gaps).^ Such an R/DSI. system structure would indeed seem to 
be Icongruent with the "underdeveloped" description we gave to the ^on- 
textual environment J and, again in many (though not all) Ways reminds us 
of iome parts of the eiucatioh and law enforcement sectors mentioned^ above. 
At least then, in terms of a relatively casual empirical, basis, thera 
woulp appear to be some face validity to our schema as far. as this has 
emerged from the Case A fiiscu^sion, ^ 



SasS'Bp by contrast t rapreseiiti a highly" Institutionalized system con-^ 
i trallad by^ the Imowledge producers . EcQnomica of scale and certainty of % 
knowledge base are high. These conditions remind us of. those to ba .fpund in 
theMnduatrlall^ed high technology hardware sactbrs (e.g*i , automofciyes air* 
craft, etc*)» Also charactarlstic of the ty^es of industries mentiqnad 
above are the hypothesised clustering ^charaGteristica- of high levels of 
speeiallzation in a teltftivelylarga number of institutions fallowing 
highly linear progressions of funetiona and leaving few or no gaps. ' 

fii. Casa C j 

Casa C varies from Case B only in that ,there' is a relative balance between 
users and producers in their level oF control over the R/D&l system as, com- 
pared to t|ia vary clear pt'oducer control of the previous situation, and a 
somewhat reduced level of certainty in the knowledge base. The consequences 
for the amargent clustering are found In a diminished; linearity and a some- 
what reduced number of inatitutidris . With^ the very high. level, of institu- 
tionalizations the high economics of scalcj ^nd a seeming balance between 
the powers of producers and users ^ this case might remind us oi thm more 
industrialized segments of the ftealth setftor , (e,g,j the tirug industry). 
The high but not total level of- certainty of the knowledge base may also fit* 
The hypothesized high specialization and the low gaps left by the medium 
sized and 'mode,stly looped institutions again fits the drug industry. 

iv. Case^ D ' . . - / 

■ " • — - ■ » ' _ ■ ' 

Case D varies from Cade C only in taking thfe economics of scale to a lowet' 
level with the effects o^""Jeneratlng somewhat smaller clusters and insti^ 
tutions with a little less spercialization. The difference might b^ explain-- 
able by reduced markets or less developed production technologies (e.g^i 
even the same drug industries ■ in less devMoped edonomics; or perhaps the 
agricultural industry), / ^ _ 
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The conteKt for CAbb possibly reflacts that^of Che aducational sector 
batter tha^ our.^ speculation for Case A/. Economics of scale and certainty 
of knowledge base are stilly very low, but we observe a less powerful user . 
group* though a somewhat higher (thougK still underdeveloped) level of 
instttutidnail^atlpn of the ^R/DM , system in its sector^. The hypothesized 
clusters are s'till looped rather than contiguous but in nbt quite as 
extreme a minner as in Case A and^ the sizes^ of the institutions are*somewhat 
smaller/* Again these characteristics seem to represent an even better ' 
description of the actual situation in educationj and the '^||minology 
example givfn ab^ove. * - . « ^ * 



vl^ Case F 



Case was described as a form^of Case ti^^ but^'operatdng ^.n a possibly less 
developed ehvlronment* Case F could also be seen' as a less developed form 
of Case C, but this time in terms of a lower level of institutionalization 
and reduced lervel of producer power in the system. Qne. could readily see 
how a Case F context could mature over time into a Case C profile* We 
could therefore 1^ talking about either an earlier stage of development^ or 
a less developed segment of a sector y Thus we might assdclate Case F with 
the medical procedXires or the' preventive medicine R/D6il programs of the 
health' field. The hypothesized^ level of specialization is lower , the 
extent of clustering greater ^ gaps arfe mo^e common and the configurations 
far less clear and line&r all characteristic signs of a less developed 
condition. The differences as opposed to the previous drug segment of \ ' 
the health fie Id j at least in *a preliminary way, do seem to conqur with 
observation, 

^ * . , ^ . ' ■• ■ '■ 

So fa-fi then, we have been able to demonstrate that the selected contextual 
coi^itions do seem capable o£ providing a realistic and rich description 
,pf varyiiag real worj^ld situations andj more important ly^ that the hypbthe- ^ 
sized c.lusteral configurations do not depart dramatioally^ from thos^j that 

{'.■' ■ I ■ ~ • ■ 



sseni to be observable In the same real worid st^uatlons *^ Further * the more 
remlistic we make the conteictual descriptions » the more realistic seam to. 
bec^a the descriptions of the comfigurations. Finally we haw seen that 
the model realistically reflects that as dynamic developmental changes in 
content occur over time^ these changes are reflected tn emergent structures 
Even while remembering our previous cautions, these are encour^aging find^ 
it^s.^ If. we can hope to develop' fuch a level of Insight from comparative 
conteKtual analysis ^ we may hope toi continue productively to the next step 
of eKploring sofae managerial and policy^ implicatfona for R/D&X sustems, 

.Si Initial Analysis of the Implications _gf Contextual determinants^ of 
Emergent Clustering for Hanagement/Poli Btrategies ^ 

A number of management issues can be identified which relate to these 
various r/d&I system conf iguratibn pat^er^, for eKample^ a key generic 
R/DSI issue is that of determining appropriate start and *stop points for 
programs in the work flow seqiience* Frequent lyj research— personnel are 
loath to let go of .thfe project-^"children" to whom they have given b^irth. 
Sometime# they *can be observed holding on to programs well, into pioduc- ■ ' 
tioh and even marketing stages^ long after they should ^lave either passed 
the project ^n to others for' deyelopment , etc*s or abandoned it. Issues 
of' judgmerit J appropriateness of skills and efficient use of talents are 
involved^ while this is always 'a problem^ it would be likely -to' appear in ' 
different' forms in the various above, ctte'd cases* In^^Cases B, D and to 
a degree F such behavior is likely ,to be more visible and^ clearly more 
incongruous to the role of researcher thaR lb the Cases A and E, where role 
defii^ltion is far •less clear/ ThuSj in Cages .B/Cj^D ^nd it may be more 
easily recognized and managed i In turn such behavior may even be seen as a 
virtue in the Case A and E contex&s (although the previously mentioned 
issues^ are likely to remain), Wa wilF return to this question again. A 
related question is the classic Not -Invented -Here syndrome which is ^likely 
to appear in mdre -aggravated forms where R/D&I functions are highly 
specialiaed and dif ferenciated (as In the Gases B and C).^ * 
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. AnQther aKampie ©f a pfttinatitf managamant quaatlpn could He^ln the dMfaren,-/ 
tlal utility and ^ ap p 1 icab Hi t y 6 f .yar lou s mahagamtent t echn ique a su c h as 3^L%^ ^ 
Tha yhigh dagraa of taskV functibn .and rola d^fiiiltlon to ba found \ In the / 
Cjase B*aiid C contaxts makei tha^app*litatlon of sueh a mafehod vary rationiLl, 
Tasks oan be apectfied and deliniataS'i ^^j|s6urda and tima raquirema^s can ^ 

. ba estimated to ^ rfeasonably acceptable lavel of accuracy/ and ,Mliabi^ 
Such may be far from the case for Cases A and 1. , As a consequefice, aMemptp 
-to transfer this * technology (which .was devaloped in the more .definitive^ 
aeroapaca/militarjr/ Industry contexts) to the *worid of education ^f or example) 

\ without appropriata j^revlaw and redesign for tha chahged eontaxt wda bound\ 

\ (as it -did) to lead to'mlsapplicatipn ^d- disappointmant ^. . , \' \ 

. ^ ■ ■ ' ^ . ■ ■ . . . \ 



Tfie use of^ Delphi tachniqiii^s to obtain estimates of cqmplax and uncertain 
phenomena (frequently of ah aivir ormiant a 1 nature; eV^.i for forecasting y \ 
purposes) within institutions is anotKer good eKarapla., The problam Is jto ^ 
find a serias of R/DM "axperti'' who can see beyond the in^iimed late task 
, and time ''environments. In cases such as B and this may not be ^so ^ ^ 

easy^ because R/Dil^^ personnel are all too often limited; in thalr/petspective 
by^ th6 very speclallgation tliat makes them productive, in cdntrastj in cases 
like A and E there Is a 'much greater tendency for personnel tg^e generaltsts 
, * In facts the normal decision procesies ar'e ess^antlally O^lphiCs thereby ^ 
making the use o*f such* an approach (while relatively easy) almost pointless. 



The managtoient of functional Interfaces Is another area o^ c*©mparatlve interest- 
^ la highly apeclallzed and dlffe^entlateJ Institutions, there are many Inter-- ^ 

facn to croflE b^atween groups with relatively well dtffine^ aad impermeable 
^ • bdundafies . Coordination i'becomes a, major J.saue'i oft^n calling f or. liason 
mechanlsmBf etc. This would seem to be likely to ocbur In cases such as B 
an4 C- In contrast ^ Cases A and E would hJve far fewer Interfaces tb cross, , 
many fimctional overlaps, and generally fuz^y boundaries between actlv;Ltia8, 
' 'Potentially offsetting these helpful effects #ould be the factors of laok 
* of linearity, which might makp interface differences (of perspective and 

discipline) larger to over^me ^ with the existence of fuMtlonal gaps^, 
creating transfer problems between cartaln R/D6fl functions. As we saw . * * 
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ear liar » sueh ,sho£-£comlngs usually aecompany the vary s^a cases that have 
^ the lower number of interfacas to deal witbf as ±^ Cases A and fi. In sum- ' 
Mry^; wfe w^ld tend to find differing types "of ^interface ^problems across 
varying R/D^I eontextg^ but Tiot necessarily. any overall greater or "lesser 
problems; And thlB indeed seems to be the ganarftl ekperience« ' 

* 9* ^ Detailad Analysis of the Impficatlotfi-of Contexteua 

Emergent Clustaring for Thraa'-Selecgad Areas of Managament Cwcarn 

_ Similar discussions could be prpstotfad to' cover a wide spectrum of RyD&l 
* m^^^gement issues and tachniques j but?thisr^ould= be baypnd our present 
illustrative purpose. Rather, wa now select the above arted managament ' 

• le-suas and methods vrtiich we will^eKamina somewhat mora fortBally in terms - ' 
of our present concerns with the Importance of the context /cluster ing.neKus. 
these were selected becauae they appear to cover a broad spectrum, of areas 
of managament cpncarn. The selected areas are* " ' \ 

^. . !• Methbas ,of Program Control (including such techniquas as PERT 
^ as discussed above). This ar^aa deals with the control of work 

and activity flow within an.l/D&I institution. 

■ * ^ \ 

2, Interface Management^ which is concerned with^the linkages within 
institutions. 

^3. The use of ,DelphU type techniques in relation to issues of an ln= 
stltution's relationship with Its mvlronment (in terms of goals^ 
and forecasts) , ' 

These three topics provide us with a^ wide ranging sample of manaeerial issues 
of both an Internal and external R/D^I system nature. 

^ Matrix 5 Is an attempt to relate , the ease or difficulty in using or dealing 
with the above t^ree R/D&I management appro-aches and IssueB to the four 
dimensions of clustering'previously discussed. The ouer-simpllf Ication is ' 
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Jfetrix 5. Use Characterlgtlcs of Selected iianagetaent 
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.again recognised and calif ^^f or both enrichment and validation by empirical 
research^ This should; bjS parried outj but^;the Indicated relationships have 
m face ^alld^ty* - - , , 

For example. Program Control is" rated as being difficult undervcohditions ^ 
of low speciaiiEation. and vice versa. As was earlier Implied, "the lack of 
certainty attachad to stage--by-stage tasks in an R/DliI process makes It 
difficult to de^flne the task requirement^, etc, and" hence to use methods 
such as PERT, The more R/Dai functltons that can be found elxistered to- 
gethar within a single ins 1 1 tft t Ion ,V however^ the easier it becomes to 
develop and na^s^tain a^ progr^ plan, since one Is dependent on fwer 
difficult to control and forecast external agents (often a major problem 
in PERT systems)* The more* linear the relationships betweeh R/Dlrl functions 
(high contiguity), the easier to plan aftd ^predict the progress of the step- 
by-step pcogreaslon. ^ Finally 4 the tfiEreasihg Incldance of system gaps ^ 
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ptbgressiyely'adds uncertali^y Co the procfS8> -taking Cke usi of programed 

Wa hava /alraady discussed most of the relacionshlps concerning latirface 
)tanagemant. As r^ga^ds ths extent of clustering, wa Qould expect ^hat ^ 
Interface problems would, be relately, easier, within rather than between / 
tost^l^tlQnSi and. hetaee favorable for the ease of higher Qluste^ing l^Yels. . 
^so Delphi methods would, as we note^ be eailet in low apecialiiatiOn 
^organisations I and we would eKpect similar sKperiei^ce In larger, looped, 
(noji^oontiguous) institutions with few gaps Xi-A,j those indtitutions havinff^ 
broader j mote ILnterdisciplinary and complete perspectives uiong pexiaonnel} « 



Using the above ralatl^^lps we ""can now eKamine the ^^arying locations 
for the a Ik previously sous s'eS cases (A thtough f ) . Referring back to 
Figure. 13 and MafrlxfJ, and once again "using a simple, computationa*! 
approach^ w# can combine t^e Various racings of the cluatering ^dimensions 



(in Figure 13) w^th^the suggested implicatiDns for the management issues 
in Matrix 5 (using the sanie scoring proSadure^ V Hi + 2 to W - 2) . - 
Thus 4^n Figjjre 13s Case A was shown As V* LO'bn spedl#lipationj which would 
lead via" Matrix 5* to a ''very dif^flcult" (VDi) rating on Prdgram .Control 
with' a -2 score, Sitnirirly * th^ High^extent of clustering for Case A* 
generates an "easy'- (E)* implicat'ion with a scote of +1^ 'and so on, Th^/net 
scores are than reconverted, for each tnanagemant isstje for each case. 



r 



this raconversion Is shown ^in ^Figure 14,' Wa have also computed the over^ ^ 
all scores and ratings a% an attempt to es,timate the extfenti of the manage'^ 
ment problam'' for each pase, , v ^ 

r ' ^ ^ . \ ' ' . , ^ 

'-From Figure I4 we observe that Program pontrol iyas rated as easy for Gases 
" B, C, and D (esBent'ialiy the high . spfecialiiation, low gap cases) and dif- 
ficult in Gases A and E (the converse cases). That is, the highly^ ^eve^^ed 
U/Dai systems (which as we suggestad could ba descriptive of the automotive^ 
' aircraft and drug r^dustrias) were ideal environments for such methods 3 

PERT* We had described ^Casa D as somewhat less develo^,ed, and although .ne 
^diffetences ware small, the slight change would indicate a possible^ degree 
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of graater difficulty. The less Uavtloped R/D&I syi terns , in Cases A and E 
(education Br law enforcement perhaps) are seen as being much, less suitable 
enviroments for such approjachfiSi with the intermediate Case F /(e*g, i Spre'^ 
v^ntive' medicine programs) baimg a quite unsuitablf environment,. In general, 
this ' a e^ia to concur ^ith experience, " * r 

^ . ^ • ^ ^ ^ ^ \^ ^ ^ . . / ■ • ' 

When we turn to Interface Management, no such dif f erences*appear . As we 
suggested earlier the offsetting factors in each Situation generate a net 

'balance in each case (although fhis may be an artifact pf our feqitel weighting 
procedure = ^ this would raquire empirical study). While we are not con- 
fident of .the mean^-ng^ of a medium rating across the board, ^e relative aim- 
iiarity across the cases is as we tfnd to observe it. Experience tells us 
that interface management is a problem feyerywhere;\ and it has not been 
our experience that it is an -^specially greater problem in any particular 
context as compared to others, Thys, instead of being concerned with dif^ 
ferehces in the weight of the problems across cases, we would be more cbn= 

.earned with differences in the specific issues and the points where the 
issues occur as these relate to differences in contexts,, . 



*The use of Delphi reflects neither of the first two patterns ^ Cases A and " 
B (the extreme cases) show the greatest differance (as axpactad) , but , Case C 
with its larger and legs Linearr. clus tars provides a better enviroriment than 
Caae B (a difference not to be Qbserved-^f or . Program Control)* Case D is a 
better environment yet^ reflecting the lower specialization. The difference 
between Cases A and E appears to mirror the shifts between CaSes B and C, ; 
Apart from the shift between Cases A and B, the overall impression . is that 
the Delphi approach is usable in most environments, to a degree, but does 
better as" the conteKts become "fuzzier" (as many proponents of the methods 
have contended * = as for eKample in recormnending its application to 
government policy making), f 

The ratings for the overall management problem ^re^specially interesting 
in their uniformity, with a single possible exception ^ Case D (although 
even there the difference is n^t dramatic) * The common language and 
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practlcally.^gtated' Interpretation of this result could be: 'IWhila the 
specific^ management problems across the various situations may be different 
from each^othfrj in total they^do not add up to a s^stanttally greater 
or leiser probiam," Whether such an hypbthesis coula stand up under em-- 
plrical study Is still An opa^ question^ hut the, suggestion, is provocative 
and one that tee ha^e no^t seen spelled out in this (br: any other such) 
manner before, * * . , ' 

Finally, we must link back to the contextual conditione that generated the 
case clustertng conditions. T^he clustering prbfiles that we used to 
a^iyie thai managemfent approaches issue were derived as a product of the, 
contextual conditions profiled in the top half of Figure 13. Thus, in 
fact it is to those contextual profiles that we are connecting the above 
management implications. That is, we could say that in contexts such as 
Case A (I.e., with low levels of instltutlonalizafrLon, high user/low pro- . 
ducer regulation, few economics of scale andean uncertain knowledge base), 
fomal Program Control methods such as PERT will work oiily with difficulty, 
Delphi methods with relative ease, and interface management will present 
no unusual problems (beyond the norms) . t 

This process of linking of contextual ^ndlkons with management implication 
could be repeated iot^ the other cases. In t}ie model in Figure 15 we show 
how the" contextual conditions link into the applicable Management processes 
through the profile of the clustering of R/mt functions in the instttuions 
i;i^ the R/DSl system. The model also indicates one more point that was made 
earlier, and with which it is appropriate to conclude this discussion. 
This Is that unlike the contextual conditions which jcted as Relatively 
unchangeable^ parameters , the management ptfoceases used could have a sig- 
nificant :tapact on the clustering (conflguratton) ^©f the R/D4I system, . - 
creating the earlier discussed dynamics. Obviously this does not apply 
equally to all management actions, and in the cases reviewed it would 
be Interface ManagMent that might: be expected to have the or impact. 
The point to be made is that management actions can Influence th# sltu== 
ation, but these must be selected so as to*"be appropriate to the context 
/in which they will be used. " * 
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ENTREPRENEUkSHIP i 
AN ISSUE OF THE HISTORICAL DEVELOPOTNT FEATURE 



INTRODUCTION 



I, THE Process of Contextual feature issue an^ysjsv narrowing the 
FOCUS ~^ ^ ' ^ ^ ^ 

1. A"^"Fu11" GonteKtual Faatura Issue Analysis 

2. Delineation of Key Issues and Character is tics \ 

A, Extractliig Kay Issues from the Full Contextual Analysis^ 

B. Salactlon of Kay^ Intrapranaur Characteristics 

C: Interactive Analysis of Kay Entrepranaur Characteristics 
3* CpntaxtuMl ^miyeis of Kay Entrapraneur Characteristics, 
4,^ Delineatian of Key Factors ' 

■5. Intaractiva Analysis of Kay Factors and Entreprenaur 

Gharacta ri^tlcs 
6, Produdt Type as a Dimansipn for Interactive Analysis . 

II, ENTREPRENEUR VS , USER INITIATIVE IN NEW PRODUCT DEVELOPmNT I 

' AN ILLUSTRATIVE POLICY ANALYSIS OF THE ENTREPRfi^URSHIP ISSUE 

1. The Illustrative Policy Isauai Entrepreneur vs. User 
Initiative in New Product Development 

2. A Typology of Entrepreneur /User Relations 
3* illustrative Analysis of Outeome under varying Usar/Product/ 

Entrepranaur Conditions 

A, The Casai ^ ^ 
^. i# ^ . Case" A 

il. Gasp 

iii. ^ Case C . ^ '-^ . 

iv. ' Case D - ; ■ _ ^ 
\ V* Case E ^ 

vi. Case F ' ' • 

\- - vii* Case Q '' 

B. Maturation 'and the Dynamic Nature of the Innovation 
Process 

4. A Cross-Sectoral Comparative Case toalyais of OR/^MS as an 
Innovation 

A, Some further Considerations ^ 

1. A Contributory Illustrative Analysis 

.2. * The Complexity of S:kill Level Variations^ 

3. Behavioral Cj^nsequences of Differences in the 

" ' Skills Balance j^V ^ . ; ._ ^' ' - 

■ B* The Adoption of New Managetoeii^^ttechnology i OR/MS,. 

C* Comparative User/Product/Entrepreneur Conditions Across 
Sectors - , - 

' . . D, ' A Sectoral Comparison^ 

1. Industry 

2. 1*4^ ,Enforcemant , * ' ^ . 
^ 3. Aerospace 
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Implications 



Illustrative Analysis of Policy/ltonagement . Options Under' 
Varying Usar/Prqduct/Entrfepreneur Gonditiori^ . ^ \ 



i, 

ii, 

iii, 

iv. 

vi. 

vii* 
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Figure X6 — TypQlogy of Eritrepreneur/User Initiative In. 

innovation ^ . 

Figure 17 ~ Comparative 'user/Entrepreneur /Product Cases- 
Figure 18 " Comparative User/Product/Entrepranaur Conditions > 
Across the Industry^ Law Enforcemant and Aerospace 
Sectpts > , 



Figure 19 



Comparative Casas^ Policy Options and Expected 
Results 



MATRICES 



MatrlK 6 " 



Illustrati^^ Full Contextual Analysis of 
Entrapreneurship Issue 



Matrix 7 The Interaction of Key Entrepreneur Characteristics 

Matrix 8 — Contextual Analysis of Orientations/Perspectives, 
Lagitymacyj Locations and Skills 

Matrix 9 — . Anal^is of Several Entrepreneur 'Attributes as 
Deteftalned by Selected Contextual Dimensions 



CHAPTER SEVEN 



ENtREPRENEURSHI'P ■ ' 
■ AN ISSUE OF THE HISTORICAL DEVELOPMENT FEATURE . 
INTR ODUCTION • = 



In the preceding chapter ^ we illustrated ^he use of the contextual 
analytical framework in relation to the contextual feature ; institu- 
tional base* In this chapter ^ ife will similarly tTTustrate tha lise 
of conteKtual analytical framewor'k in relatiori to a specific 'issue 
of the historical develdpment feature: ^ the role of the entrepreneur^ 
in the hi'storical development pf'R/D&I gya^ma. 
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, This issue Was selected thrQugh a process of prog^aaiyery narrowing 
down from the historical development feature. That discussion is con- 
talned .in the full report. Easentially, this involved the Idantlflcatton 
^f a factdr tKat has been-observed to be of critical importance in the 
d\sseTOination, transfer and implementation of innovations , especially in 
lassjthan fully matured R/D&I systems/ Thus in th^earller phases of 
the llfe^ cycle of R/DM systems the need for "product champions" or ^ 
"entrepreneurs" has been shown to be of vital importance In th^ "success" 
of new product and process Innovation^ introductions and adoptions. 3j 8 ) 

The issue gi entrepreneurship is presented as one illustration of the 
several such issues analysed in the full report. Our purpose is to 
demonstrate, the process by which such a question can be eKamined from 
the generic perspective , leading into a potential, comparative analysis 
across several eontexts. In this analysis the contaKts will be hypothetical, 
but the extension to real world conditloyis should be relatively ^eXf 
evident , ^ . " 

The analysis will follow a "reductionist" niethodology . ^On a step=^ 
by-step basis J we will gradually narrow the focus of the analysis of 
• ^ the "entrepreneurship" issue until wa have reached a level of analysis 
which 1^ limited enough for an ana lye is to be manageable yet still 
rich enough for meaningful illustrative policy analysis. In the 
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process of narrowing' the focus of analysis ^ wa shall ''carry along" 
Significant aspects of a fuller contpxtual analysis to enrich a^more 
^ specific illustrative policy arialysis. Additionally^ we ^hall hive 
creatad a ^'fdbt'path" whereby a more specific illustrative policy 
analysis may be "led back" into an Interaction with the fuller con- 
textual analysis. \ 

To fufther enrich t^e specif fc Illustrative policy analysis , we. will 
provide a comparative anal^sl^ across three sectors from empirical 
c^se studies. ^ ^ , 

To begin our narrowing of the focus of analysts , we will limit our 
analysis to the fol lowing?^ . - 



1. the producer (or developer/producef) as enferepreneur (recognizing 
that entrepreneurs may also be users ^ disseminators ^ etc^ but 
omitting these from this analysis) ; 

2. the early phases of historical davelopmant of R/DM system 
(through & very limited CDmparlson will ba made with a more 
mature stage of the innovation process), 

TOE PBIOCESS OF CONTEXTOM. FEATURE ISSUE ANALYSIS : NARR OWING THE 



FOCUS 



jU A "Full'^ Contextual Feature Issue Analysis 

We have defined "context" as the interactive effect of the whole set 
of R/DM system features. To pemlt full analysis of the feature 
issue of "entrepreneurshlp" In R/D&l systems as a function of conteKt 
variation^ It would be necessary to Interact this feature issue with 
each of the R/D&I system features and feature issues. That is to say^ 
we would Initially explore the set of research^ and policy questions 
that emerge from the interaction of entrepreneurshlp as an Issue with,^ 
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for example: * h litorlcal deyelop^nt (the, role entrep^eneurshlp plays 

in the Instftjutlonallgation procassf how it functions in the v.arioul^s^ 

davalopm^tal phases; what happens to entrepreneurs over time; etc.); 

environment (what are apme of, the legal/p^olitical constraints that 

may operate on the entf epreneur) ; comparliig the development , product Ian 

and marketing / dissefalnation ^sub-systems (how might the type of skills 
_ - ' _ ' ■ ^ 

required differ across the various functions of ^an R/D&I system)* Thus 

a complete analysis across every feature of an R/D&I system ^context 
would be ^ecesBary to. establirti a basis for the full contextual analysis. 
This is illustrated in outline form in Matrix 6. 

i - 

Matrix 6 provides an illustration, in outline form , of how such a full ■ 
contextual analysis could be dona. In this first Instance^ Matrix 6 is 
a first cut at. the. process and relies on the knowledge and experience of 
the analysts with the recognition that^the a^j^ys Is is likely to be 

Improved through a se'rtes of iterations , as more Is learned, There^ are 
clearly, ^ therefore, advantages to the use of interdlsclpHnary and inter- 
sectoral teams In the .proceea . From a pragma'tlc perspective, it is vital 
to avoid becomlhg bogged down at this^point by concerns with exhaustlve?-''^^ 
ness or the desire to include everyone -a favorite perspective* 

Delineation of _Key Issue^^nd^ Characteristics 

A, 'Extracting Key Issues fron^the Full ConteKtual Analysis 

A complete and systematic analysis of eaeh call of Matrix 6 
would be grounded in the llteratura Is beyond the scope of thip 
review* Furthermore, .such an exhaustive approach would not hi- 
practical for policy making. In order, to focus in on questions ^ 




both high priority and of general applicabilifey to the area of 
particular concern (in this case entreprenGurship in R/D&I systems), 
it is necessary to narrow do^tl the ^ range of issues to be analyzed. 
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MATRIX *6 : 
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. ILLUSTRATIVE. FULL CONTEXTUAL AN^iys'lS''€^»RiCTREPRENEUJRSHIP 
^FEATUKE M ENTREPKtteJRSHiP ^ ^ 



ISSUE 



Environmant 



Historical 
Pavelopment 



Legal/pplitlcal-' eonsfer^ints 
Impact of norms .. ahd^l^Va-lues 
Economic cons tr air 



Funding prioritiea 
Techrio logical requlrertants 
Knowledge base \ . ; ■ 



Role in ins^titutional^^ation 
Which phase needad \" , ; 
^Establishment o$ Institutions 
Impact on acceptance 




Institutional^ Base 
(Network of Institutions) 



Entrepreneur as ^ linking agent 
Effect of boundaries skills required 
Effect of stt^^Udture^ configuration^ sizes 
varying entrepreneur role legitimacy 
Level of sponsor support 



4, Goals/Policies/strategies 



Effect of goal setting 
Tiine horlaon of goals 
Perception of goal^ 



5 . Adminis trative 
Processes 



Control of 



MoblliEtng support and resources 



* 6 • PepsQnti,el B 



ase 



RecrultTnent and selection 
Career patterns 
Professionalism 
Obsolescence 

Training and development 
Distribution of expertise 
Status ^ 

^fotivatton arf3 satisfaction 
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REPRENIURSHIP 



11 Eundtng 



Constraints on use 



Level (suppor 



mm.! 

t ior) 



.8. ItrtEormatlon Flow 



Role ' ' 

Information seeking akills 



9* Innovations 



Life Cyclte 

Impacts and benefits = role 
Effect of character of the inno- 
vation for product) 



10. Need "identif trar i nn 



Role 

Skills required 
Responsiveness to user *deinands 
Ins titutipnal base 
Position 

Personal characteristics 



II, Generation /Research 



Role 

Search skills 
Tech transfer role 
Information flow role 



12. Development - Role 

, - ' Skills 
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13k.: Production 



EOTKEPRE NE yRSftiP ; 

Role 
Skills 



14, >fa^k^ing/DlstrlbutiQn7' . * .Role 

Dissemination /Di££ua Ion Skills 



15 i Acquisition 



Rore= of key personnel 
Product chanip^ions 
Skills of user' personnel 



16* ir^^emantacion / 
' Utilization 



/Aole of key personnel in implementation 
Producer/user relationship 
producer characteristics 

^ Implementation capability 

User characteristics 

Innovation entry points 
Barriers^ (overcoming) 
In=house capability 



Role of ehtrepreneurs in utilisation 
User relationih^& with sources of 
innovation ' i 
User characteristics influencing 
acceptance of innovation . 



17 s Support Services 



18. Evaluation Research 



19. Research R/D&I 
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' This Is dowd by eKtraetlng those key iisues whleh surface ivom the 
: Qvmrvim\i[Qp Matrix 6, in the sense of being either critical or 

parvasive/aeross many dimensions of the R/D&I system context* As 
a first yStep tDwards ^e definition of key polley Isjiues, It would , 
seem rfasonable to eondentrate^ur further effort oh these issues, 
in th^B easA we ean Identlfjr tne following^ 

Xw the role of the entrepreneur as this shifts ^aaFoss the 
various f una t 1 Otis of the R/D6i£ system (development^ 
marketing^ ete*); 
2, the skills and characteristics of entrepreneurs | 
3i tfte entrepreneur as a lltUc between the knowl|^ge producers 
^ and useM (with special reference to ^he problems of 
need Identificatlonj implementatlo%^nd utilization) * 
We mus^ reiterate that these are certainly not .the only issues that 
might be of concern %jo the researcher ^ manager or ppllcy maker* 0^ 
Others^ can and (as necessary) wquld be selected. These are, however, 
issues that from our analysis of MatriK 6 appear to be of general 
and sustained importance across R/D6£l systems , and hence worthy of 
I some priority for a first (and Illustrative) analysis, . - 

B. Selection of Key Entrepfeq^r Characteristics 



To provide a sharper focus for analysis of these key issues,, it will 
now be useful to describa a set of entrepreneur^ characteristics for 
more* detailed consideration* We select (from Matrix 6 In a m^y #« 
Ized form) those five ^ entrepreneur characteristics which* it vouii 
appear have a critical impact on the key issues as we have identified 
them I , 
Or ienta t iorL - Is the focus of the entrepifeneurshi^ local nr 
cosmopolitan? ' . *^ 

Per^pecttvQ Is the emphasis a' theoretical of applied; 

■ ^ ^ ■ 

. * . innovation or on^ utilization.? 

Legitimacy" of origins - What is the impact on legitimacy if 
the source of entrapreneurship is external to 
' the user organization; whether the source^ is 
peripheral or core? 
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InstltutlQnal RoU .iQcation In system - Where is the priMry 

. entrepreneurial activity to tie found i In the 

eore or at the periphery of tfe prd^u 

^organisation* - ^ 

Skills - What type of skills are required In performing 

' entrepreneurial funetions i need^ identif ica- 

tlon^ fflarketlng, consulting/service, 

.... i development: 

§' , ■ • ■ - 

' ' ■ , f " - ■ . ■- ■ 

C. Interacblve Analyali o£ Key Entrepreneur Characteristics 

' \ - - ^ . ■ ■ 

Further^ it will now be helpful to examine the interaction between 
the entrepreneur eharaoterlstlcs td determilne their Independence 
robustness and general causal direction as is Illustrated by 
Matrix 7, ' 



The i^licatlons of the Matrix 7 are that: , \ . 

1* The^p is a mutual interaction between orientations and ^erepee,tives , 
In fa^ti these would seem likely to be highly inter-correlated 
concepts which are (for our policy purposes) of only marginal 
difference. Thus we can elec^t to collapse these into a single 
confound variable: "orientations/perspectives". 



2. Skills (which were defined in terms of need Identification, 

searchT (developmental), marketing anS consulting service/^ 

skills) seem similarly to be likely highly correlated with 
orientations and perspectives; but on both theoretical and 
practical grounds (manlpuL|bllity) , it seems desirable to 
maintain this variable separately in the analysis. This 
possibility of mantpulability of the skills variable (through 
recruitment and training) may be particularly significant. 
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Legend r ^ geparal causal direction* 



3* Institutional role location seems most clearly to be an indep|endent 
variable in determining orientation/perspective and legitimacy* 
The impact of role location must be seen in terms of the types of 
skills that are required in a given role location as well as in 
terms of skills that might be acquired. It is also possible |to think 
in terms of role location having been determined in response to 

available skills and orientations/per spect Ives of personnel 
although this seems iess likely from a pragmatic policy per- 
spective * ^ ^ ' 

"7"^^^^ - - — j = 

* The general causal directions Indicated in Matrix 7 are derived from ^ 
our general knowledge of the relevant' literature. In a more complete 
,analysis3 we would discuss the relevant literature from which these 
causal directions are derived. To do so hercj howeverj is beyond 
our intention of providing an illustrative analysis 

* ,.- ■ . < ' 

. ill ' 



4. Thje legitimacy of the entrepreneur Is likely to be determined' . 
by ©rlentations/parspeatlvea 5 skills and role locationi Thus to 
most users, an entrepreneur with local/applied fmple'mentation 
orientations /perspectives , having the perceived neceesary V 
sklll'ss and workitig rom an aeceptable institutional role loeatlott 
Is likely to be Invested with the necessary lagitlmaey to per- 
fom the role. An acceptable role location would be determined by 
the history of prior succesi^and trusft^generatlng relations , 

, and perceived authority and appropriateness, 

5, In general the variables in the matrlK (allowing for the col- 
lapsing df the orlentatlons/perspeetiVas set) appear robust 

^ * and this ancourages us to take the next analytical step* 



3/ Contextual Analysis of Ka^Entrepreneur Gharacterlstics 

We are now ready for a "second cut" contextual analysis in whl^ch. we 
will again consider the implications of antrepreneurshtp^ across each 
" of the features of the R/DM system* This time, t^wever j^^jrathar than 

^ ■ -r' . ............. 

considering antrapranaurshlp in general (as we did "^iri Matrix 6)5 we willV 
consider* a much more narrow Issue, Specif icallyi we will consider the 
Implications of the Interaction betwaen each of the key entrepreneur 
qharacterlstlcs (orientations/perspectives ^ legltlmacyi location and 
skills) and each of the contextual features* At this level of detaij.j 
we will begin to sm ,the potential for policy options emerging from 
the analysis^ altho^h some further narrowlng/in focuSi''fi3y still be 
helpful, Hatrix 8 represents this "second cut" context^tG analysis , 
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Orietitations/ 
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Location' 
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, 1. Environiint 


, Interijctlon with 
notis}& valuii, ^ 
of uiirs 

r . 


Intariction with' 
hoMs & valuai of 

USMS 


, Economic & polit-. 
'ieal regulatibns ' 
.constraints 


' tiiplct of te^no^. . ^ 
Iplical riqulraninta 
and knowladgi bill 


2. Historical 
Developiint 


ChitlEi oVir tlma 
ipd phis\s of di- 
va lopfflitit 


'and phases of de» * , 
velopMnt ' 


uoggrvcQ GQan|iS: 
over phaiis of di* 
. Vilopient 


Ghinging requiramiats 
dvir tlm§ and phasa 


3., Institutional 




Variation of role 
legitiniacy acrois 
institution type 
Sponior support 
Proddcer/usBf co* 


Effect of boundi 
ariiij configura- 
(tioti, size 

i 


. Orginizational and' y > 
inter-orpnizitional % 
s^ requirement! 'i 

, ^ . ■ ■ ' . . ■¥ 


■ .---...j^... 




^ 4, ■ Gaals/Policles/ 
Stratigies 

■ • 

t ' . 

f ------ ^ ^ 


Impact of goal per- 
ception dlfferendes 
and interaetioti with 
parciivid vilui of 
the innovation to 
» users' 


Impact of |oal 
sittln|- processes J 
|oal cwifllct ' ' 


IipacE of goal dlf- 
ferinci^in vwioui ' 
locitiofti 


■4 

Skilli required for ■ ' 
varying goals 
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5, AMaistFatlva 



6, Fi^§OQQil -Baaa 



7. 

4 



8, Infpmitioi^ 
Flow , 



9. Innovltloni 



iptivatlgti & 
/§atis£accion 



Iffiet of iviil' 
'ability of uiir 
resourceg on 
intriprenaur 
lotivition 



Ability to cocitrol 
'Ability to lobll' 
izi riiourcea *. 



Effeet of level 
of fundini cofi''' 
striints on use ' 



Effact of level 
^ funiini con- 
straints on usa 

■ 1 



Effect of- location 
on place in coi- 
fflunications net 



Inforiation seeking 
skills, Effect of " 
on skills needed 



10» Niid 

Identification 

0 . ■ ' 



Personal character- 
istics i Perciived 
naed for innovation 



lisponsiviMis to 
user deniands 



Institutional 
base k posation 
and ability to see 
needs, 



11. Gineration/ 
Research 



Constraints on techi 
transfer 



Location in inform 
Biation flow 



12i Divelopnient 

13. Production 

14, Marketing/etc, 



Differences 

across 

functions 



Differences 

across 

functions 



Skills to recogriiie ap'^ 
plication needs and po^ 
tent ial means of satii^ 
faction 



Search skills ■ 
Tech, transfer skills 



Skills required / 



1^ ^j*",quisition 
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.16. IttpUiiiatatlonf ■ 
;■ iltiliiation • 

1 ! . : ■ : 
! . - : 


Entrftprina'ur/usir 
intirictipn of • 
firiintitigfti/per'" 

ipictivai oh ii- . 
plenintation/util- 
iiitlon 


Importance of 
legi'timacy on 
iopliffiantation/ ^ - 
utilization 

. EKpected barriers ' 

r > 
,.8 


Iipict on linking 
role 1 Relation 
Me^usir entry 
, points . 


i 

Skills riquirid 
. Intiriction with ' 
. user skills 

s 


■Wi r Support aervici 










18* Iviluition Reiiirch 










19. Rissarch on 

^Im . 


■ . ■ 

- t' — 









I 




A preiimlnary rBview of Matrix 8 indicates areas that appaar eBpaeially 
fruitful for comparatlva contaxtual analysis. Thus environmantj goals, 
instltutignal basej need identifications implementation/utilization and 
prntBontiml base laem to provide a rich basis for conteKtual variation 
aeross the £p^v areas of entrepranaur attributes under examination. 
Furthers while Matrix 8 has bean developed in terms of each of the four ^ 
salacta^, antrapranaur attributes s we must recognise the Interdape.n- , . 
dencies indicated in Matrix 7# ^ 

* ■ 

4. Delineation of Ke^ Factors 

— — — — ~" : ^ ■ ■ - ^ f 

With the above connnents in mlndp^ we can now. identify several unifying 
factors (or themes) which appear to be critical soiffces of conteKtual 
difference .and which can be extracted across all the contexfual features*, 
as analyzed in Matrix 8 but with special attention to environmen,t , 
goals s institutional base, need i^ntlf ications implementatifin/utiiliEa;- ' 
tlon and personnel base* * ^ 

ly— ^ ^ereprieneurrus&r interaction in the values realm 

Differences (or congruence) in goals _^ , _ 

^fferences (or congruence) witH user in perceptions of, 
need for and value of a given innovation (in the light 
of available user rfesources) ^ 
^ Difference's (or congruence) in orientations and perspectives 

(e*g*: relative to pragmatism^ ^time horizon, local/ 
^_ ^ cosmopolitan) 

2 .^ Entrepreneur user interaction in the knowledge/skills realm 
Skills for r^ed idehtif ication, search, implementation, and 
lAilizatlon 

* Relativenass to the nature of the knowledge base Ce*g*; 
scientific vs. craft, level of certainty) ' . 

3^"^ Envlrdtiment context of resources and support 

Availability or limitations (e,g,i amounts, stability, etc.)^ ^ 

of funding, personnel, information ^ 
Sponsorship and constraints ' 
Ability to mobilize resources 

Conflict/ oioperation (e.g,^ available coalitions for tmplementation; 
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From 



this 

^ 2* 



Stguetural feonteKt of entrepreneur /user relatlona. 
Linking roXes 

Nature of boundaries and organizational conf iguratiQii 
Ingtitutlonal sl^e 

} . ' ' 

analysis, we can see that our focus Is now upon: 

interaction between entrepreneur/ user attributes In the 
value and skills realni; and 

the resource/support and structural cpnteKts of ^ntre-- ' 

i ^ ' ^^^^ 

preneur/user Interaction*^^ ^ ^ 



In Matrtk 8, we engagedn ln an eKploratlon of Vnany of the contextual 
factors that might be expected to be of Importance in an analysis af 
entrepreneur attributes. The above discussion has acted both to capture 
some (but not all) of ^he richrtMs of. tTKs analysis and to parmlt ,us= to 
focus In on a more llmjr^ed numb'rtQ^^Blloy relevent contextual is&^e 



areas . 



Th#se issue a^ejB m 
1, when and-^^tf 



^s*£o^*Tsa 



( talking Int^ 
potential ^ 




determinations about : 
^^meuri^ activity might be desirable 



and value differences between 



l^fenemra aqd potential innovation users; 
2.*^^^i^ls that anpe n^ie^d,^^X?^klng into account the entrepren- 



^ eur/usei? skl^f fit); 
3* requirements (in the are 
4. institutional and struqtur^ 




e^ources and support) ; 
aracteristics * 



j * t ^ t ly ^ _ ^n a 1 y s 1 s of K e y . Fg c t p y a ' Pfefl^ E if t'fe'e praneur Charact eristics 



The concerns we have Just listed would pr^id^^the outline for a 
of analyses relayant to a series at policy optioris and prog^pms. 
everj for the purpose of providing a ^ single illustrative analysis 
we must yet take two more st 
one to ^ad4 an extra/ dimens*i$ 




one to further narrow our focus 
our ang'JLysis, 



number 
How- 
here , 
and 



EKLC 



'ji, i 



1^ 



..MATRIX '9: 

-^^ - ■ ' ■ , , ■ . 

^AL^IS OF SETORAL ENTMPRENEUR ATTRIBUTES AS DETERMINED 
- BY SELECTED COKTEXTUtf. DIMNSIONS 



Selected Dlttenslons of 
Gontaxtual Conditions 



i Entrepreneur Attributes 

Orientations/ 

Perspectives ' Legitimacy' \Lt5cation Skills 



User Attributes 
1.1 Values 

a) Goals- perceptioni 
of va'lue of In^ 
novation 

b) Orientations/ 
perspectives 



1,2 Knowledge/Skills 

a) Skills for: 
-Implementation/ 

utilisation 
-Need i^entiflca'^ 
tion and search 
^ ^for ; the innova- 
tion^ 

b) Knowledge base 
relation 



Resource Support 
Context 

a) Resources 
' b) Support : 

-Sponsorship 
» Conflict/ 
cooperation 



Structural ConteKt 

a) Linkage rolas 

b) . Boundaries - 

c) Configuration 

d) Size 



*Thls ii^lie,s the skills of knowing what is "heeded and how^ and where the 
need can be satisfied^ : ^ . 
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i i ■ ' . ■■ ' ■ ' • ' 

. ^ .- " ^ • " ' " ^ ' 'ti " 

Mafcflx 9 would ptovlde the framework for an intaraetlve sMlysii qf the 
kf(y faetorg and entreprenayr eharaetarlstics to which we have thus 'far 
Mtrowed our foeus from the original largar set of contextual condttidns 
^(whlch we have postulated as bein^ all R/DM systeffis), | 

A €0^iate analysts of the issues lip licit in Matrix '9 would be very 
dasirable and enlightenlngs but baypnd the'scopfe of our ptasent ll- 
^ ^^ustrattve effort* / unquestionably contains a sufficient 

. dpoaiti for a substantial dissertation, We^ have therefore ,^ refrained 
from attempting to fill in the cells of th# whole mat%^ *but. rather 

wili^conaentrate now on that smaller portion that has befen shaded in : ^ 

■ - - " /■ ^' , ^ , . •• = 

the matrix. This represents the Interaction between entrepreneur. . 

* - - <^ _ \. " ^-C ' ■ ' •• 

skills, and user attributes, but with special empl^Vls oh.the skilldP^; ^ 

areas (as being potentially apectally suaceptibla*3to policy Initiatives). 

" - _ -. . ^ ' \ ■% r J^^- 

6. Product Type as a bimeneion f o^ Interaetlve^toalyB^lsj ^> 
\ In addition to the above entrepreneur and user variables, ^thfei'e is. 



one other aspect that we have not yet considered- the sjAstantlve / ' 

oontent lof the innovation ' thdt 1^ the subject of the entrepreneur 'a^^ 
activities. In the interactifsn between the entrepreneur and the user, 
the nature of the product (or Innovation) is a potentially critical 
parameter 'for the analysis* In this specific case It would, for example, 
make a great difference if the entrepreneur was pramotlng a new In- 
novation or a more matured product; whether , the product was simple to use and 
tpB benefits relatively self evident^ or a difficult to ase product of uncerta 
benefit* Thus the innovation (our'R/D&I feature 19) in this case is* a key 
factor in this analysis* A,t a general level of analysis ^ we might' 
conceptualise the iriteraction as follows; 



Entrepreneurship Attributes 



CQnteKtual Conditions 
(other than product Type) 



Product Type (Innovation) 
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More specif ic ^ to our purposes here, the Interaction would be: 



Entrepreneur Skills 




-y User Attributes ^ 



Product Type 

> ■ - - / ■ " ' 

II. EOTREP RENEUR VS. USER ltaTIATiyE_IN NEW PRODUCT DEVEL OPM ENT ■ 
^ . ^—^^ ^ 

AN ILLUSTRATIVE .POLICY ^ALYSIS OF THE ENTREPRENEURSHIP ISSUE 



We have now reached the point where it. becomes feasible to under- . * 
take detailed theoretical but policy-directed analyses. We have 
thiia achieved our stated objective of following a reductionist meth- 
odology (l.e.s narrowing our focus to a inanageabl.e level) ^ while at 
the same time pulling with us those critical conteKtual conditions 
that will provide a rich level of analysis thereby perinitting us 

to^deal with a focused (and therefore policy and management actionable) 
issue in the larger frame of reference . 

.Furtherj we have followed a procedure that would enable us to -trace 
back any implications Into the toftfcj wholis^ic framework. This has 
betp indicative of a deductive approach. It is Jjnportant to emphasize 
that in practice the selection of an issue area (or areas) might be 
arrived at inductively, . The primary purpose for the matrix analyses 
in such cases is to fit the analysis into a comprehensive framework 
and relate it to its relevant conteKt features and to other issuea- 
Also^ it sHputH be noted 'that the general guideline for determt|iing when 
sufficient detail has been achieved is a pragmatic one ^l^*'" ^~ 

detailed as is useful to identify and/or deal with specific issues of 

ff* ■ . _ 

p^lcy and management concern, ( . 

1* The Illustrative Policy Issuer Entrepreneur vs . User Initiative 
in New Product Development 

Let us now proceed by analyiing a significant policy Issue that involves 
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the consaquances. of antrej^eneuyal bahavlor in the Innovation arear vi 

Considerabla yintarast has been racfently focused in studies of R6^ and 
Innovation, on whether the entrepreneurial initiative for new produc^^ 
development and introduetion derives from the initiatives of producers 
or from the initiatlvea of users (see for example fhe work of Radnor 

and Neal, ^^\^^n Hippel^^^^ and Abernathy ) . Thus, in the technical 
instrumentation ease Von Hippie has identified the users (customers) as 
the prime stimulus source. In contrast j Radnor found the producer to 
be the prime mover in certain law enforcement equipment cases ^ with' 
randomness almost seeming to be the most reasonable description of the 
procMS in most other law enforcement equipment cases* Abernathy has 
coBsnented on the fact that as a product area matures (as in the case 
of automatic machine tools), there may be a shift. from user to producer 
(supplier)* Many eKraples can be cited from the health field of fully 
cooperative ventures between producers and users (e^g*: Schermerhorn ) . 
Of course 5 we must allow for the possibility of eKternal -imposition of 
innovations, 

Im A Typology of Entrepreneur/User Relatioils 

From the f4w examples noted abovej it seems possible to construct a 

typology of producer (entrepreneur) /user relationships in terms of InnovativS 
initiative. ' Since we are focusing our 6nalysis on the producer as the entrepre^ 

neur, the typology in Figure 16 below (and subsequent discussion) will use the 

term ■'entrepreneur" to refer solely to producers. 



1. Entrepreneur dominated 

2, User dominated' ' ' - 
■3, ^ Cooperative (entrepreneur /user ) 

4, Externally imposed 
- 5, Serendipitous 

FIGURE 16 - ' 
" TYPOLOGY OF ISNTREPRENEUR/USER INITIATITO IN INNOWTION, 
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Given a poltcy objective to intervene and manage the innovation process , 
knowledge of the conditions that might lead to and influence these 
processes would be vital. We are now in a position .to connect our 
analyais thus far to this issue^ area of innovation initiative in a 
demonstration of our lnd^ctive/dedudtiv€ process . ' 

From Hat rlK 9 and our earlier typology of product dimensions, wa may 
see our analysis as involving: , ^ . . 

User Attributes . ^ : 

. Implementation/utiliEation skills ; 

Need Identification and search skills * 

perceptions of the value of the innovation with respect to resources 
Product Characteristics ^ . 
Maturity of the product 

CompleKlty of the product with respect to user knowledge^ base*^ 
Entrepreneur Skills « 
Need Identification 
Developmental 
Marketing 

■* 

#p Consuiting/.g ervice . ^ 

3, Illustrative Analysis of Outcome under Varying User/Product /Entree 
* preneur Conditions 

The abpve scheme can be Illustrated by selecting several varying sets 
of conditions (cases) drawing the partial, implications that could con- 
tribute to a total study. The seven cases we have chosen for analysis 

^are summarized in Figure 17* These seven cases illustrate some of the 
likely outcomes that can be expected under varying user /product/entrepre- 
neur conditions* ' . ^ 



*Only twQ dimensions have been selected to simplify the analysis - as 

relevant -Otherar would be^. required* . _ , ^ - _ 

** Product complexity here implies complexity in acqulBltionj imple= 
mentation, utllizationj m^alntenance , etc. » Thus It captures the issue 
of the nature of the knowledge base that provides the criterion for . 
relative user/entrepreneur skills, 

^**It is Important to keep in mind that the analyses and later derived 
policy implications are only partial and contributor^ to a total analysis 
in that they are limited to the sub-set of variables we have chosen to 
examine, 
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1. Case A ' 

In Case A we have an entrepreneur with well developed need iden- 
ttfication, developmental and marketing skills In relation to the 
nature of the product j a new and corapleK one. The entrepreneur 
understands the user's problems ^ knows what products are needed, and 
can deliver them/NHe also knows how to reach and make the sale 
to the customer 3/ but can do little to assist in the implementation 
and on-gotog utilization problems of a user who Is weak In thfse 
same area^^nd therefore needs the unavailable help, Additlonairy , 
the user lacks the competence to be able to identify (or to dif'- 
ferentiate between) what and whose products might (or might not) 
solve his problems ~ but sees a high value to any innovation 
that could help. 

As a consequence It 11 the entrepreneur who doralnatea the innovation 
process. He takes the initiative both as to determining the char** 
acterlstles of the innovative product and as to providing the link- 
age with the user. In thlSj an Important service is provided to 
a relatively helpless user a u^er who (because of the great 

perceived value of the Innovation) Is found to be highly receptive 
to the entrepreneur ■ s initiative and product, Unf ortunattlys that 
Is where matters iome to^a halt. With a compleK product (and given 
both the^ user's and the entrepreneur's lack of implementation/u ti,li- 
zation skills) we are likely to encounter failures at this stage of 
the Innovation process.* Artother continuing problem Is that the 
user continues to be highly dependent on the entrepreneur for future 
innovations in the same area. The inevitable long-term result is 
great f ttis trptlon. 

The above is a very familiar scenario. It Is Interesting that case A do 



*For the sake of illustrative simplicity we are ref trlcting these cases 
to two party situations. In the compleK real world there ara often 
more Chan two key parties to a relationships e.g.: In tbii case a 
partial compensation could come from the existence of cbnipetent consultants 
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well represent our observations of the two-way radio market for 
police dapartments Iri the case of the unsuccessful (or vary much 
less successful) producers * 



11, Case B 

Case B, hoWever, rapresents the condition for the extremely sue- 
cassful entrapreneur In the same market one that has coma to 

capture the bulk of ^he business in the field, yet, Interes tingly, 

the two profiles for A and B show only one point of departure* In 
Case Bs the entrepreneur has strong (high) consulting/service skills, 
am compared to weak (low) skills in Case A*^ 

As In Case A, the entrepreneur is the dominant innovator to a re- 
ceptive, user market but this receptivity extends to the service 
as well as the product area. The entrepreneur now is capable of 
prdvlding. tha vitally needed help in implamentatlon and utiligation 

^ possibly setting up techjStcal service functions in an equlvalant 
of an "eKtenslon service". As a consequence^ ^success rather than 
failure attends these efforts; end Instaad of frustration^ we 
observe a growing productive interdependence. Other users, ftua- 
trated by their experiences elsewhere, Join the relation^ even 

/ though they might not prefer to .be "captured"^ by the growing .giant , 
And capturea they are. The very '^success" of this relationship ^ 
illustrates its problems. Captive users may become resentful of the 
Increasingly powerful entrepreneur, who sees no incantive to help 
upgrade the skills of dependent custoiners. This can lead to re- 
sistance aT^d may reduce tha great service provided in the field 



situation upon which the success Is founded, 

; 1^ 



111. Case C 



The same type pf product (new and sophisticated) is found in vise C, 



*This is not to imply that there may not be other important differences 
beyond this analysis framework. 
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but thla time It Is the user that posessas the critical need 
identif icatioTij search and implement at ion/u cillzat ion skills rather 
than the eflfc^epreneur * Now nothing moves until the user: (a) re- 
cognises a need for a specif ic Innovation precisely defined (some'^ 
times even designed) by Itself; and (b) initiates a relation with 
potential producers (possibly In the form of a request for a bid 
to produce a^sp6clfied product). Even though the entrepreneur's 

f ; ■ 

marketing skills may be valuable in helping to land the contract^ 

It will be the. usef that will dominate ttfe innovation relation, ' 

The entrepreneur - s task is made easier, but his ability to. make a 

technological transfer of the innovation to, other applications 

may be llmltfed both by his own possible lack of skills in develop- 
ment and/or need Identification and by the control that the user 

may exert over products of its own initiation and design. ThuSf 

the entrepreneur may be limited In eKpanding the market^aize beyond 

the original user, and the limited market acts. as a further constraint 

on innovation. This is often the situation where highly sophisticated 

users (e.g^s the large automotive companies or high technology 

federal agencies) ?contraGt out to machinery or instrument makers 

for a highly specified new product* 

iv. Case D ' . 

In Case D, we once again find a naive user faced with a new and 
con^leK innovattonj as in Cases A and B* In some respects, the 
user is in an even worse condition because he is less clear about 
the value the innovation. However, in Case the entrepreneur 
(unlik^ Cases A and B) cannot compensate for the user's need identi- 
fication weakness -- he tooj is ill-informed on which users need 
what* Even his developmental skills are suspect; and he can give 
little Implementation and utiliEation assistance. Under these 
conditions it* would be surprising that users and entrapreneurs 
manage to find a proper fit* That this does occur of occasion is 

_ „ _ _ = L L'^' — 

best ascribed to serendipity, ^ ■ 

A problem of signlfiQant magnitude is that the considerable marketing 
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skills of the entrepreneur In Case D can lead to users acquiring 
Inappropriate Innovations (gadgets and fads) that may squander 
searce resourees. Outside pressures (for exaTOple ^ f rom political 
and lay sources) may be difficult to resist because the user lacks 
justifiable alternative programs* The world of education and many 
areas of local government seem to fit this context In various product 
areas, 

V, Case E ' / 

Case E mirrors Case C in teCTns of product and user characteristics 
- - except that we now observe a mature rather than a new product 
sltuatipn. The difference is significant* The entrepreneurs have 
had time to learn the biisiness in. all its aspects and to become 
appropriately adapted.. This permits them to assume the dominance 
of the innovation environment and allows them to entrepreneur In^a 
wider market , This is a coimnonly observed phenomenon , as Is the 
case where a machine builder is able to ^evelop a general purpose 
(as opposed to a Specialized) product that can serve a variety of . 
applications areas* Under large market conditions , problems of 
over-competitiveness can develop. Many entrepreneurs can l^arn the_ 
business and the highly receptive large market is a major attraction. 
In some other cases ^ the constraints of the original application 
area or the original Innovation limit such generaliEation* ^In those 
cases, the entrepreneur lacks Incentive and the relation tends towards 
one of limited entrepreneur/ user cooperation. 

Another potential problem may arise precisely because of the soph- 
istlQation of the users. To themj nothing produced on the outside 
tnily measures up to their perceivad needs ^ nor ^he quality of the 
product they could produce themselves (but for the constraints of 
time and cost). This of ten surf aces in the ^'not- tnvented-here" 
ayndromes with users feeling obligated to rework products that are 
acquired: to set up Idyosyncrat ic specifications demanding high 
priced *'speciats" as opposed to off-the-shelf standard products; 
and so on* * 
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vi. Caie F . . , 

Gases F and B are more^alike than'they appear at first glaitce on 
paper. The overall level of available skills between entrepreneur 
and user are not greatly different^ but they are significantly dif- 
ferent in distribution in two areas i need identification and im- 
plementation/utilisation* 

In relation to need identification under Case F conditionB^ the 
user and entrepreiTieur find their fit because each has some degree of 
capability to seek out the other in an area in which innovation la 
needed and not generally well understood* (A high/high combination 
for tieed idei^lf ication would also have this result, but would 
generate a greater level of potential independence of the parties ^ 
than occurs in Case F, wherfe" a fit is established,) The parties 
in Case F need each other because they each have some difficulty 

s 

in idantifying appropriate alternatives. This may be true even 
when the relationship is less than optimal (e,g,: there may be 
more competent entrepreneurs around , bu^ a switch may be seen as 
difficult and/or risky by the user)* 

Additionally, the user needs some In^lementat ion/ utilization help 

which the entrepreneur is in a position to provide but 
has a iufflcient level of ln=house competence to be able to accept 
help in a productive manner. A cooperative relationship is the 
obvious consequence. The very comfortableness of the relation may, 
howeverj act to constrain technology tra^fer to other applications 
and may reduce the incentive for the entrepreneur to sharpen its 
med identification skills^* ^ Long term consulting relatiotiships often 
have these qualities, 

vli,. Case G 

The flnaL Case (G) , unlike the others , -involves a mature product of 
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low coi^lexity, but with users and entrepreneurs having the s^e 
characteristics as in our first Case (A). In this instances the 
slffipllclty of the product and the long user and entrepreneur 
aKparianca both facilitate the selection' and implei^entation problems. 
The technically weakest user can adapt to the product requlrera^tsi 
the relationship becomes more cooperative; and the entrepreneur's 

dbtaination lessens. This does not guarantee that the ysar is " 
adopting the proper products ^ only those to which he has become ac- 
customed* The form of the "cooperatlveness" could be a combination, of 

market research (what does the user want) and persuasion (marketing/ 
advartising) * The simplicity of the product may invite competition 
from small, sometimes low skill entrepreneurs (alley shops) 
unless scale considerations prevent this* In the high volume, mask 
uaer cases (consumer industries) , the entrepreneur maintains dom- 
ination due to the dlffuseness of the user population, 

Bg Maturation and the Dynamic Na^ur^ of the Innovation Process 

^Case G and the previous Case E are important in our analysis In 
another respect. Both* represent eases of mature rather than new 
Innovations, As such they depart from our original perspective 
for this whole analysis, namely that we are enplorlng the entre- 
preneur/user relation in the early . developmental phase of an 
R/D&I situation. The comparison of Cases A and G emphasizes the 
importance of the time dependent maturation process. The learning 
and mutual adaptation that go on lead to modified outcomes. Even 
the difference in product complexity between cases A and G could 
be Interpreted, at least in part, as being a shift in perception 
resulting from learning and adaptation. While it is not- necessarily 
sOs one way of looking at Case G is as a more developed or matured 
form of Case A, 'with some (though not all) of the problems having 
become ameliorated. This recognition must reinforce our understanding 
that the innovation process must be exatnined as a dynamic phenomenum 
in- which t^ie^changing _ role of the entrepreneur in relation . to the 
user may be of critical importance* 
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4. A Cross-Sefyotfal Comparative Case Analysis of OR/MS as an Innovation 



Some Further, Considerations 



1. A Cpntributory IlX^ustratlve Analysl,s 



^ ..'-'MS'* 



Before going on it la Important to keep one point in mind* 
Entrepreneurahlp was se^acted for illustrative purpotes 
out of" a larger set ^of issues* The matching of entrepreneur 
skills with those of the users was similarly selected. Our 
'purpose has been to Illustrate the insight and eKplanatory 
power that ^an be derived , from bur analytical procedure. It 
has t^ot pretended to completeness, but rather to being con- 
tributory (perhaps importantly) to a total system analysis. 

2 * Th e C omp 1 exi t y o f S kl 1 1 L ey e 1 Va r i a t i o ns 

i : ' . ^ 

Before we leave the analysis of these cases to go on to con- 
sider the policy options and management strategiies available 
to deal with the emergent problems ^ some enrichment of the 



r 



analysis would be helpful. For simplicity we have categorized 
users and entrepreTOurs as being highj medii^^.or low in any | 
given skill area. In practice it is not quite that simple. 
A user may have generally high implementation skills j for 
example J but ^lack eKperlence in a specific applications area^ , 
Such a mBT is not in the same condition as a iteer who lacks 
such skills in all areas , including that of the specific ap- 
plication, 

3, Behavioral Consequences of Differences in the Skills Balance 



We have also not 'given full recognition to some of the behavioral 
consequences of the diffeTCnces in skills balance^. Thus while 
high entrepreneur to low user implementation skills can be 
seen by the user as helpful ^ the balance could (as we noted) 



also lead to resentment, mistrust and resistance. In turn 
low entrepreneur skills could lead to lack of legitimacy in 
the eyes of a highly skilled yser (although we did not have 
suct\ a case among the seven presented In relation to the. 
* implementation/ utlllzat ion skill area) ^ ■ . 

B* The Adoption of New Management Technology: QR/!^ = 

The specific case involves the adoption of new management tech- 
nologies in the 1960 *s to early 1970 's — specif icallys oper- 
ations research /management science (OR/M and associated methods) . 
This case is taken from empirical observation. In this case the 
issues just noted above will appear^ — as will the dynamic nature 
of the innovation process which we noted earlier* The case is 

also interesting in that it deals with an example of entrepreneuring 
a software (systems or service^, application as'oppqsed to a hardware 

product j within institution^ Ci.e#i through Internal entrepreneurshipj 

The case is given acrosa three sectors i Industry ^ . law enforcement and 

aerospace* . ^ 

C* CgmparatUve Us er/product /Entrepreneur Conditions Across Sectors 

In the three sectors , the comparative uBer/product /entrepreneur 
conditions re levari t to the Introduction of OR/MS as an innovation 
would rbe approKlmately as in 'Figure 18 (using the categprles in 
Figure 18) , it should be kept In mind that the empirical studies 
found considerable variation across Institutions . In each of the 
three sectors* Thus, wa recognize that there may be a potential for 
variability from these ratings in any category, 
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Industry Law Enforcement Ae ros gaca 
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Imp^l etne nt a tib fl/ U^l 
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Medium Low 

\ 



Medium 
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Low 
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_Prbdu£t 

: r"'~ ' 
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Complexity 
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Low 
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Need ID . 
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Consulting/ Service 
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Low 
Medium 
Low 
Low 



Medium 
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Low 
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? Figure 1^ 



Comparativf User/Product/Entrepreneur Conditions 
Across the Industry, Law Enforcement and Aerospace Sectors 
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D. A Saetoral Cotp^artgon 
1. Indu^^^ ^ 



In big Industry^ the antrapreneuM of OR/ffi methods wars (by . 
ind/larga) highly skillad practitioners of 0)^/^ taphnologies ^ 
(rm waak In their understanding of user problems, poor in 
tetlpg-^^^atenGaj and at best fair In their ability to 
asrfst in implementation »^ ^ In contrast, thalr ellants 
the ultimata -^usars were relatively uafa^tllar with OR/B^ 

n^ethods^ ^Ithough many of them had considerable knowledge and 
mperlanca with alternate techniques and approaches to sblving 
the problems involved. They could , £airly quickly, develop 
an app£H|clatlon"of appllcattbn methods ^ expected outcoines, 
and (Importantly) see the weaknessas of new techniques vis a vis 
their needs* Initially, users (often with the support of other 
competitive high skill professional groups e-g** ae^ 

countants) tended to react, more to ttetr perceptlortg of these - 
weaknesses than to ^recognize potential OR/Jffi benefits. The 
result was an Initial clash between the OR/MS entrepreneurs 
followed by an intensive (and generally successful) period of 
mutual education of users to OR/bB *and of ORftB enjtraprenaurs 
to user needs . This led eventually to widespread and relatively 
successful adoption of OR/J^ in the larger industrial firmss 
with the technologies coming to diffuse widely within these 
firms. . 



2, Law Enforcement . / 



In the case of law enf orcement ^ the internal entrepreneurs of 
OR/MS were themselves 3 in general, also not very sHilled in 
t'heir technologies. Their clients were even lass skilled than 
^ their industrial counterparts in either the OR/MS or equlva- 
lent techniques. As a result the OR/MS "revolution" hardly got 
off the ground, and it took the infusion of skilled external 



corisultants in a major role befora noticeable progress was to 
be ^observed. Until the skill level of the entrepreneur^ was 
ureraded in this way, little in the way of transactions was to 
_ bl-=¥^f f^ctM tfTts^e^^ example of Case D above . 

' ^3 ■ Aerdspaee , * * 

In a ease crossing Indus try/ government lines (aerospace) , both 
OR/MB entrepreneurs and clients were technically very skilled. 
As a result there tended to be^ a high level of Initial agree- 
ment and a limited pet of applications were implemented in 
mutually agreed areas. However extension of OR/^ to other 
problem areas, was limited to continued acceptance and utll= 
" Ization In the early agreed areas , somewhat like the result 
of the previous Case F situation. 

Bji_ Implications ^ . ^ 



From these cases wa might observe that a small entrepreneur-to-user 
skl^l gap can have very different results s depending on whether this 
occurs at mutually low skill levels (as In ^he law enforcement ,case) 
pr .with mutually high skills (as In the aerospace case). Furtherj 
where the entrepreneur has a large skill Increment over his cllentp ( 
in the general Industry case)/ if the clients start ata high enough 
level the potential may be excellent for adoption and diffusion^ even 
though there may be considerable initial problems to be overcome 
the clientele is essfentially educatable as long as the entrepreneurs 
are flexible enough to mutually adapt to educated user needs^. 
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5^. IlluatratlVa Analysis of Follcy/Managemant Opttons Under VarylnR 



The earllav analysis of seven ease situations (Cases A^- G) generated a 
nui^eF of policy/management relevant Issues within each ease situation, 
This atialysls pan be pursued further to Illustrate some possible policy 
and management strategies available to the various parties In the R/DM 
system^ Figure 19 Illustrates some of these potetttlal actions whleh 
could be taken by the users ^ the entrepreneurs (producara) and by mi 
%uper-ordlnate (general level) policy makers (e*g*i top manageMnt In 
an^organlEatlon or. In the macro case, a federal agency). This figure 
showa In each case the results that might be expected if the potential 
option or strategy is exercised. 



Case A ' ^ 



The problem In case A was of a low skilled user dominated by an 
entrepreiieur who was unable to assist in the Implementatlon/utill- 
zatlan-of^-an— innovative and complex product (and iB^licitly assuming 
the unavailability or of third part5^; assistance frqm con-^ 

sultants) , ^ 

The user's ^strategies fall into two general but interactive categories: 
(I) upgrading Its own skills and (2) switching producers/entre- 
preneuri, if this latter option is feasible, 

By improving need identification and search capabilities (which might 
be done directly or in fact through some form of contracting out as 
with consultants) , the ^ser would be better able to know what products 
are needed and whete to obtain them^ thereby creating greater user 
freedom viz a vIe potential entrepreneurs. Improving implementation/ 
utilization *skllls could increase the success of the innovation 
activity and= again supplementa the user-s Indepenclence, In turn ^ this 
Independence -and the associated improved need identifleation and search 
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skills makes it feasible for the user to switch to an efltrepreneur 
(if sueh an alternative is available) that can better supply its 
needs p with similar cdtisequances for success « If the switch takes 
place without the prior io^rovement of user skillsj then the danger 



of becoming captive (as in case p) arises* 

The strategies for upgrading in-house user skills would usually 
Involve some combination of training and recruitment of new person- 
nel and contracting out as ndted* A partially similar; result can 
be obtained through improving the flow of product and process 
infomation on avallabillt^s applications and perfonnance evaluation 
This is not usually within thejower of the user to influence 
externally. The user can^^ however , attempt to Insure utilization 
of information which is available (although unfortunately most 
such users that need the help cannot differentiate between poor 
and good quality inf oriEation) , Infomal relations with other 
trusted and more competent users is frequently another source of 
need ^identification and search inf ormationj and properly exploited 
this strategy can be of great assistance* - 

The entrepreneur can atten^t to upgrade the service; and consulting 
provided by it- to users* This would have great benefits to the 
u^er making it less necessary to either build individual skills or 
l^bok elsewhere (although the former response has the already- . 
tmentioned problems of leading to user captivity). Depending on the 
situation this could be a difficult, costly and slow-to-achieve 
strategy (e.g. it might re^l^e the setting up of a' national 'field 
service network)* In the /^nfta-organl^atlonal case it may call for 
a changte of style of Qpexatiori and the number and t^e of personnel ^ 
a possibly more feasible If sometimes uncomfortable (and hence 
resisted) option* - ■. ■ * ■ , 

A top level policy group or a goverraient agency attempting to inter^ 
vene In the case A context should be aware df the leverage opportuni- 



•11 



ties that axlst in supporting users in their atts^ts to upgrade 
, themalves through training and recruiting efforts. Other polley 
options mighty lie In supporting the emergence or development of 
departmental p local or regtonal Information servlcfs. ipeclal 
--~sub--lssue Inyolved^ln li^r of JLnforoatlon flow 

to users which lack necessary need Identification skills Is thw^~ 
creatloA of sooe forni of product sta^ards, thereby sl^llfylng 
the usar's decision problems* The creation of l^roved Infor- 
mation services and standards programa are, as we noted above, 
outside the sphere of .Influence of most users, but is a most 
appropriate policy option at the governmental level and even at 
the organisational level for large Institutions, 



Support could eiso be provided to entrepreneurs attempting to 
build up their skills. Within institutions this may not be a ma^or 
problemj but at ,the macro level, governmenta may be constrained 
in supporting one^-3producer over another in terns of the effects 
on competition. Even so, ample opportunities may be available. 
These could Involve the aupport of model programs designed to 
assist users on implementation problems, etc,, with obvious self 
Jtxal ning_ an^^sx? t em^ spini-off effects. These oppo rt unl ties could 
alsQ involve the promotion of Joint Venturas^ e,g,i between or- 
ganizations with strong development skills but poorer service 
capabilities and other organisations having complementary strengths- 
and weAnesses (e,g,: insisting that large prime contractors 'sub- 
contract out li^lementation and service roles to smaller regional 
Institutions that may survive only bacause of their strengths In 
their specific areas). Even the strengthening of a single entre- 
preneur wirr the Lieeded skills could act as an incentive to the 
others to make similar improvements if they are to prevent erosion 
of their po^sition with clients and customers as these gravitate 
towkrds the unit providing the better, service. 

* •• ^ '\ 

We imist also not lose sight of the fact that, as we noted earlier, 
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we are dealltig with a dynamlG plienomanon with time- dapendent 
eharaeterlstlcs ; we are looking at 'in iaaua that Isvolvea 

an hlstarical developmental prpcesi of innovation. To an In^ortant 
degree -the problems we are disoussing exist baeausa of the emergent 
and davelqpmental character of tha R/DM process. With sufficiant 
time and a low rate of new introductions of innovatlonp coMide^SaBTt 
learning and adaptAtl6n~catr~and usually does take placa although 
somm (or much) of this can be^ maladaptive and dysfunctional t 

Hence one policy option ts to do nothing. Over tiiaap even without 
much help s users will ta^ to work out a tolerable degree o£ 
in^lamantation and utilisation (or alaa disappaar) and many 

will gravitdta to those entrepreneur/producars that can provide the 
needed help. Entrapraneurs will gradually learn about the problama 
of a limitad user group, and became more halpful. Depending on how 
critical the problatns are, ^at othar prlorittas axist, and tha 
feasibility and cost of altarnatlve action atratagias, the daelsion 
wi^ll have to ba made to deal with Identifiad problems or neglect 
tham with these considerations applying to users j producars 

and highar laval policy makars* 

We recognized this earlier wh^n wa noted that case 6 could be con- 
sidered as &3monomous with casa A but in a maturad f orm. The 
differences in context and outcome could be ascrlbad to tha effects 
of learning and adaptation over tlma* This strategy (if we can call 
it that) does lead to solution of some of the Ifflplamehtation/utlli- 
2 at ion problems; and more cooperation between producars (former 
entrepraneurs) and users tends to developj even though soma of 
the basic structural weaknesses reraalti (possibly to haunt us - * 
we still see users making inappropriate product acquisition decisions) 
Case B can also be viawad as a developMnt of A over time. If the 
outcomes in A are sufficiently fCTistratlng, then soma users will 
also find their way over to a Case B conteKt prior to any real 
learning and adaptation (if this is feasible there may of 



: ■ ^ / ,. ; • ; , 

Qowtsm not be an ent rep rena^^^jf. t h casa B charactarlstlcs avallafcle 
In any glvan eontaxt) . As earlier Indicafead, to the axtent that 
this ean and does oecur, it will ereatie an incentive to other 
antrepranaurs to upgrade their own skills to counteract sUch* a 
trend V although as ti66ed this may not always be feasible* ~ 

The discussion of policy options and stratagles for case A above 
Is basad oh a perspectlye that Is very dlffa^ent from the one 
which can be obsarved in the making of much of current federal 
government r/D&I policy, Hera we typically encounter the situation 
wheri an observation is mde that a particular context has sho^m 
^ ^history of lack of successful innovation* Whether thip has been 
due to an insufficient flow of innovations or a record of poor 
iiDplemantatlon on the part of uwbxb is Dften less clear* That 
both of these problema may be derivatives of poor interaction 
between producer /user skills relative to the novelty and coi^leKity 
of the applications Is almost never considered, 

- - - . ' ' \ 

Instead the problems tand to be defined as the result of: * 

1, a lack of incentive on the part of producers to innovate 

(to be solved "by creating more competition; by subsidizing 

Innovation act tvityi e.g.j by the special purchasa of 

Innovative products by government in the hope that. this 

will lead to more general application and diffusion 

as in the ETIP , program or the National' Bureau of Standards)! 

2* a lack of capability of producers to Innovate (to be sblved 

by having goverimient doing it for thaffi ana^through various 

# / 

programs of teechnology transfer and^utilization a.g* 
Technical Utilization programs) 

V V 

3. a lack of incentive by users to adopB^innovatlon (provide 

subsidies ) \ ^ ^ 

4, an inability to iimovate due to lack of resources, information 
and skills (provide subsidies ^ pre^^packaged programs and 
model programs); 
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5* a raslstance to ad op ting Innovatlpn (to be ovarGome by 
various typas of enforcamant and sanction proeasses, 
Ihspiratlorial treatffien'tsj and behavior Influencl^ng and 
modi^lqatlon programs: e.g.^p use of ^artlcipaclDn and 
- feedback etc* ) * 



This la not to say that the above analysis of problsms are nacag- 
aarlly wrong or the proposed solutions useless. To the eontraryj 
it is our position that a eoo^lete analysis of a situation looking 
4 at Issues of fundlngj incentives^ aapabllltles, infomation flow, 

^ problems of iB^lementatlon/utillzatlon^ etc* (as would be the 
product of a conq^lete study using each of the dimensions of qur 
analytical fraro^^^k) would turn up the same Issues as aboves and 
many more. Rather It is to reinforce our position that only 

I through i^uch a total R/D&l system analysis can one hope to reach 
Into the^ reaj causal factors and develop appropriately balanged 
policy, optlo^ and management strategies. * 

It Is therefore the objective of our present illustrative analysis 
and policy 4^rlvatlon effort to deiaonatrata that there may ^e critical 
perspective^ that can contribute to the SKplanatlon and solution of 

frequently ^Kperlenced problem situations and that these critical 

_ _ _ _ ■ L ' ■ - ■ - ^ - — . . .... . : . 

perspectives that tend to be miesed without the type of systems 

perspective and contextual analysis we have been Illustrating, It 

is in this light that th^ above discussion of entrepreneur/user 

skills interaction has been presented as a partial contribution to 

the analysis and solution of outcomes in the Innovation process. 

In the cM^lete analysis the findings and recomnendatlons above 

would have to be weighed against and combined wlth^ alternative and 

coB^leTOntary eKplanatlons and strategies* 

11. Case B 



Case B, as described In Figures 17 and 19^ is In most ways tl^e same 
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as Case A and most of the' previous dlscusslbri of Case A 

need not ba repeated hers. However , there is one basic difference * 
In Case B, the entrepreneur is already akiHed in the service/ 
consulting. skills^which are lacking in Case A# 

In one sense^ tw action is called for in Case B. The situation 
is alteady favorable to the entrepreneur ~ so he will not want 
to "rock the boat-', , However, the "monopoly power" poaition of 
the entrepreneur leads to user dependence and thui to user resentment 
and even potential resistance. The alert entrepreneur might thus, 
wirthin a brpader and longer time ^hfizonj 'attei^t to assufte the ^ ^ 
role of helping the user in^rove its own skills thus moving away 

from "monopoly power" based relationship* The enjrapreneur is even 
more likely to assume this role where there are signs that users 
are becoming receptive to such help and/or where other sources 
(e.g^: the federal government) ai^ initiating programs to make 
such help available. = . ^ 

iii. Case C "^^^ 

Case C involves a highly knowledgeable user controlling th^ in- 
novation relationship for a novel bsd compleK product with an 
entrapraneur with weak naed identification skills* The problem 
here was centared in the -limited domain of the Innovation base 
with limited tachnology transfer to' other applications and wider 
markets. Under some conditions this would be Ideal for the user 
who preferred to be the sole beneficiary of a particular technology, 
Howavers the cost might be higher prices for the very specialized 
products in monetary and/or personnel effort terms* , ThuSj to lower 
costs s a user strategy would be to work with the entrepreneur to 
make It possible for the entrepreneur to take on the dev^elopmental 
'burdens (from the user) ; to supplement its own innovative efforts 
with those of the entrap raneur ; and to Increase the entrepreneur's 
efforts to reach a wider user group hence creat'lng a larger^ 



^- domatfi for' the entrepvaneur and potentially lower coats to thi 
user, !■ "Y'- ' ' .. ." ' . * ■ , ■ 

■■ ■ . ■■ ' ^ >. ■ ' . - 

* The ;entrepren«ur could (If It iaw the wider opportunity) seek to 

upgrade its .skills. Including ^aiming from the users (pbaslbly 

by putting in nio;ce- than the mltiittura manpower effort to' satisfy ' 

^ y ^ . 'i ^ ' ^ . ■ ■■ 
the contract). Thlfe should result In a gradual shift In the 

balance of the relationship, jd^tlculatly if a ^^ider market were 

emerging which would permit the 'i#ntr4preneur to Invest In relevant 

competence at a much higher rate":; 

^ . " ^\ ■ ^ , — 

" _ » * ' ^ . . f / . -. ^ 

Superpordinate level policy makers j espaclally at the governmental 

level, could seek to build up entrepreneur eoi^etence by providing 

Incentives to develop R/DM programa'and assist In the creation 

of informattort diffusion (technology uclll^ation) progrtea. This 

could help widen the Innovation base and stimulate grea^r dif- , 

"fusion of the Innovations generaced by the user, 

Ivt Case P a ' ' ' ^ 

sirendlplty was our desGrlptlon .of Case D* /Naive users were being 
served by entreprei^urs whose only cle#r competence was in siarketing 
in A con^leK and Innovative applications area. Clearly there ara 
major beneSits to be derived, by both users and entrepreneurs In 
generally upgrading their skills^ laadtng to a better, fit between 
user needa and products and feervlcea provided^ ^ Users might make 
special effprts to be in contact with other more competent users , 
/ thereby gaining the benefits of their experience with sources and 
product^* With. such relatively helpless userSj the entrepreneur 
. which; does build up Its abilities to provide relevent and needed 
servldei can hope to win the long term loyalty (and even dependence) 
of userl in' fact converting, to a case B type situation, 

'i- ■ " ' ■ ' • ' ■ ■ 

Suppor& for training pj^rama for users and entrepreneurs Including 

posslbil^ joint pro|^&) could be. a useful strategy for super- 
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ordinate level policy .makers. Other options wuld Include tile 
setting up on Inttmatlon diffusion syatams (newsletters , maga- 
ztneSs BTI syatemss etc.), the establishment of^tandards programs 
and systeTO to create common product and perfoitaance crlteriaj and 
(potentially vary Important) the craatton of consuiy.ng and service 
organizations and groups available to both entrepreneurs and users* 
Oam of the indirect benefits of such efforts might be to make 
Innovation programs motm defensible and less subject to pressures 
from outside groups (stockholders ^ the citizenry » etg,)* ' 



v. Case E 



Case can be looked at as the end product of the various policy 
and management programs and the effects of maturation* All skills 
are high, the product if matured, although in this case (unlike G) 
still seen as complex. However, as there are no perfect solutions 
in organizations 5 the key problem is that of a potential insularity, 
and provincialism that could develpp with the Non- Invented -Here 
..syndrome. Each group believes itself too skilled to need the othi|r' 
help. The objective of policy programs, especially from the per- 
spective of users and super-ordf nate level policy makers, would 
be to encourage personnel and Information interchanges to combat 
these potential problems. Government policy makers and top managers 
might be especially anxious to diffuse the benefits of the available 
skills to other areas, again through the interchange and technology 
transfer mechanisms » From the perspective" of the entrepreneur j it 
is vital to maintain an active R/D&I program to stay with or ahead 
of users and so maintain position. There are other strategies 
between 'such entrepreneurs (such as collusion) that might help 
them, but these are not usually acc pet able (or even Illegal in 
the U.S.) ' . 

# 

Vi; Case F 

The cooperative Hltuatlon lii Cnfie F, In cuifif ortahlt^ but: iiiniting* 
Users and ont rup ronnii _ ihmuI (»acli (it^hcr dun to l:liuir niuttinl? fihcjrt^ 
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comings but are not nacesaarily performing at an optimal level * 
The improvamant in need identification, search and devalopmental 
skills (as appropriate) can lead the user to wider and possibly 
better* options and possibly at the same time stimulate com-- 

petition and (for the entrepreneur) open up wider opportunities. 
To the extent that the entrepreneur can asslst^the user in skill 
development 5 this may help to generate future user loyalty. The 
policy requirements at the super-^ordlnate role are to help broaden 
the bases of the Innovative activity for both users and entrepreneurs 
through supporting or creating IriArmation diffCision and technology 
transfer prograraa. 



vilt Case G 

Case G represents a potentially matured condition of case as 
we earlier noted. The user-s needs now are to^grow beyond its^ 
present limited perspectives that^ make it suseeptlble to the 
acquisition of ginmicks and fads through development of Its dis- 
crimination (need Identification) skills* Improved implementation 
skills would add to its independence* These thoughts would be 
very appropriate whether we were discusaing institutional or mass 
consumer users (the purpose of much of the present consumer educ- 
ation efforts). From the point of view^of the entrepreneur, im- 
proving service skills could enable the entrepreneur to lead users 
into more complex applications and products ^ and thus out of 
the matured 5 low complexity product areas which are likely to be 
highly competitive. The role of top level policy makers j especially 
government, would be to upgrade the quality and relevence of ap-i 
plications by asslstitig users to upgrade their skills, by the 
creation of consulting and service organizations (e.g. : consumer 
advice bureaus), and by the creation of product find service standards 
(e*gp: Underwriters Laboratories j Consumer Reports, Product and 
Performance Standards in industry, health, food etc p ) . 
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CHAPTER EIGHT 



CONCLUSION 



As wa n©tad in the Preface, this report precedes (and inciudae materials 
to be included in) later volumes , which will be more comprehensive and 
will ba written for selected audiences: R/D&I system researchers; 
policy analysts and policy makers; and the educational R/D&I conmunity* 

In this report, our intention has been to lay the groundwork for under- 
standing innovation as a total knowledge production/knowledge utilization 
process; to describe a comparaLive contextual analytical approach to 
R/D&I ; to provide a basic framework for contextual analysis, and to illus 
trate how the contextual analytical framework might be utilized to ana- 
lyze, describe and derive research and /or policy /management relevant 
Implications* 

Since the discussion in this report has intentionally been illustrative, 
there now remain two tasks to be done in order to conclude this report* 

First j it will be prudent to "overview" briefly the contextual analy-- 
tical approach in order to place it in proper perspective. The context 
tual analytical approach recognizes t^at innovation involves a total 
process of knowledge production/utilizations that the various aspects 
(features and feature issues) of an innovation process interact with 
each other and thus cannot lk(^ adequately understood apart f rom this 
interaction; that there are b<^th generic and sector-specific character- 
istics of R/n&Ii and that a concrute real-world R/_D&I system emerges 
from the interaction of generic R/D&I characteristics and a specific 
sectoral con text. Thus * comparisons of R/D&I Institutions , sys terns , 
and sectors must take into account both the similarities and diffarencus 



that arhsfihe result of an "emergent" procesi; and analysis of spe-- 
cific R/D&l institutibns 5 systems and sectors must take Into account 
the interactive totality of their contexts. j 

We have in this report suggested a framework within with such an , 
intaractive totality of contexts may be ""captured" for use by re-- 
searchers and by 'policy/decision makers. It is important to emphasize 
that this framework is J us t^ that a frameworks a methodoldgy* It 
does not "give answers" or "make decisions" p Nor does it substitute* 
for knowledge about R/D&I^ about a specific R/D&I aector/ayf^tem/insti^ 
tution, about specific R/D&I functions, or about the specific R/D&I 
issue which is of concern to a researcher or policy/ decision maker.^ 
Quite to the contrary^ such knowledge is a critical ingredient for ef- 
fective utilization of the contextual analytical framework. Further, 
the framework specifically allows the utilization of the various per-- 
spectives, models, etc* which may relevantly be brought to bear on a 
particular area* 

^ Chapters Three through Seven of this report have attempted to illus^ 
trate the use and utility of the contextual ^analytical approach p The 
fact that these discussions have been illustrative presents the second 
task we must complete in concluding this report — namely, to give 
some preview of the usage of the contextual analytical approach in 
more specific , concrete situations. To accomplish this task^ we have 
chosen to include in the Appendix the following materials ^ 

1, First, we haye included a selected excerpt from a recent 

policy analysis which was prepared by CISST for the National 
Institute of Education and which utilized the contextual 
^ analytical approach* 

2p Second, we have included brief summaries of recent or 

proposed applications of the contextual- ^iialytlcal approach 
to a variety of R/D&I Issues in several sectoral context^^. 
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The overall Implication of this report which we would emphasise 
in these concluding remarks, then, Is simply that specific R/D&I 
research and management /poUcy issues need to be undarstood in 
terms of their interaction, with the totality of their contexts* 
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mEFAGE 

THE CONTEXT OF THE ISSUE 

Before beglimlng our analyals of the appropriate balance be- 
tween "Fiald-Inltiatad and Age^y^-^lrected'* RSi^^ It will be Impor- ' 
tant to framm the Issue in its proper conteKt, This can be intro- 
duced by a brief discussion of some central questions for NIE today 

What are NIE's responsibilities towards U.S, education in 
general and educational in particular? How can the Agency 

utilize a very l imi ted budgat for the best short and long term 
effect^ and how might it justify a proper increase in this budget? 
These are central policy questions, as are such related issues as* 
the Hunger and types of personnel requirgd within the Agency; the ' 
proper place of an in^-house Basearch effort (if any) i how NIE 
should relate to the "Field"; the current priorities for NIE in 
tha "Field"; and NIE* a relations with other Agencies that may be 
playing roles in either educational RfidD or in. educational practice. 

Any attempt to deal with these issues must begin with a rme^ 
©gnitidrt of their inter-^connectednaEs , For all its looseness , its 
inadequacies j there is an educational system to ba dealt with 

and NIE is a critical element of that systems What is done in one 
area or in relation to one issue will likely af fact other areas 
and have impact on other issues* For ajcamplej the build-up of 
development efforts in the pa$t has had implicatfons for the state 
of Applied Raaearch and the needs and opportunltiea for Dissemina- 
tion now, VJhaC the Agency adopts as its mission will determina its 
budgetary priorities and in turn how it should and could relate to 
the Field, 

The recognition of the current state of educational R&D (in- 
^ eluding the total innovation process) is as critical as the ree- 
ognition of its systernic character* It i^ loose; gaps are 
characteristic; and inadequacies are all too common. In short ^ it ^ 
is a very "inmature" and weak R&D system, Wliat then arc the Im-- 
plications of these two characturioticn of being a oystem and irnlng 
immature and weak? 



- 434 - 



If education Is to be served by a quality R6^ systanis two major * 
* requirements will naed to be satisflad. These involve (a) system build« . 
ing, maintenance and protection and (b) system orcheBtrat ion. 

Only futility and frustration can come from policies that ignore the 
state of the educational RW system; policies which implicitly assume* 
viable Research/Development /Dissemination and other instijtutiona which 
are reasonabl*y well linked^ to each other and to practices policies which 
assume that Users are able to adopt quality R&D outputs ^ able to properly 
generate and implement their own significant innovations and able to iden-- 
tlfy and feed forward their real needs to DeveloperSs etc,; policies which 
assume that the provision of funds to procure R&D outputs and programs are 
the primary requirement for success* We suggest^ in contrast^ , that syatam 
building J institution building and rebuilding ^ and personnel development 
are top ^urrent priorities for educational Rfi^* " Further , it is mot enough 
merely to build* A fragilej politically exposed' and weak system must be 
maintained and protected* 

A mature R&D syptem orchestrates itself. Relationships are well de- 
velopad* Participants know what to seek and to deliver , from and to t^erej 
and what to expect and trust* An immature system needs help to growj to 
learn how to achieve such a self organizing state. 

These are the needs, NIE may not be: the largest governmental contrib^ 
utor the. educational R&D establishmerit ^ but it is* the Isada the core dis- 

cretionary ^fency, NIE must take responsibility for the system building 
and orchestrating. No other body can or will, NIE could walk away or be 
prevented^ politically^ from assuming this mission; but the need would 
remain, as well as the ensuing frustration. In our analysis we have taken 
the assumption of this mission as a given ^ along with our premise that 
tjiere is an educational R^ system^ albeit Imniature and weak. 

This sets the scene for our analysis. If we ,are to understand the 
factors that determine the what^ ^en, how much and how of the -*Field- 
Initiated vs Agency HDirected*' R6JD issuer it must be in terms of our under-- 
standing of , the total Dducational_ R&D system as it now is*; as wq mighC 
wish it to become; and as it varies across Che differing Qle.inentfi of Lhe 
system (e,g, as between Research and DGVelopment) , To do thii^ wa nned ;in 
itppreciation of what is fundemGntal and generic in R&D and what if; cliarac^ 
teriatic^f the p resent educational KM) contoxt. 




'Such understanding will' ne%d development and presentation ^if 
we are to be able to deal with the issue at hand. It may^ inci- 
dently (because of the aforementioned inter-connecdedneas of 
ayatem iaaues) also provide some insight to the t^^^ of questions 
ifaleed at the start of this preface. Some very brief thoughts on 
those questions may be a fitting introduction and entrfie into pur 
analyaia* . 

i.' 

II* ^ BOm RELATED ISSUES 

The limited size of NIE's budget in relation to the needs p and 
" even in compariaon to what is being spent In total on educational 
RM)j Is .well reeognizad in the Agency apd in the National Council 
oit Educational Research. What. are some J^nsights that may be help 
ful in developing payfflietegg _and guidelines for bud^e^ary planning 
that may be derived from the analysis that we present below? 

This is clearly a large policy issue and=we can only hope to 
suggest some, useful parspectives In these few comientSs 

We would need to begin with an evaluation of the capaqity of 
the R&D systenij overall and across its parts (or functions as we 
will be terming rtiem--Basic Research^ Problaitt^Focused Researcbj 
Development I Dissemination^ ©tc.). What Is there now (in terms o£ 
capacity, product inventories , etc*)? What aan b^ delivered? What 
Is needed (capacity 5 outputs) now and over the longer terra? In our 
analysis we wi^ point out the needs and requirements of the diff=- 
erfent functions^ -and how these may differ over time/ 

Specif ically^ In our analysis we will note that because of . ^ 
fianding policies in relation to the Development function ^ there' are 
some quality Development organizations and an Inventory pf Deve^lop^ 
ment products. What has been missing have been the quality control 
functlonj the Peveloper/User linkage and the .User/Product matching 
(and tailoring) ftinctionsp We will further note in our analysts 
. that the Problenw Focused Research and (until recently) the Dts-^' 
semination functions have' net baen wall develppcd and f\ro. weak, 
' ft We will note^ that overall thta aducationaL system 1b relativaly 

immature , 
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Given these e^Mltidns and ^Cha oonsequsnt nfeedj^or syat^a-fcuiid- ' ^ " ^ 
ing^ how can NIE b4sb allocate its financial reaqurQes? To answer this 
question raquiras cdnstderation of several factors* For ekample^ 



i, T^ere are inb^rent differences in funding re qMjdresiantssh@tween^ 
ftmctions?* For exmnples both Instltutton building and project 
costs ;Un Basic Research tend to be lower tfian for Froblem Focusiid 
•JResearcH"- which v turti tends to require less fupding than 
Developmet^^ t-#e, the incremental impact of funding additions 
and reductions is variable,, 

2* The tlma required to build a system will vary across functions, 

. .'.I! — 

^Fox exajnplej the time required in Basic Research would be quite ^ 
aignif^aatly greater than for Development, Relktedlyj so are 
the tinfe^briEOn needs ^and impact of furiO-lng changes. Skills 
^^taka lojiiyir to^build and the disruption caused by funding 
variatioM have much longer consequenQes, 

3, As Siebar (19?5) has noted^ in the system building process there 
needs to be a balanca in the total system among functidna^ psc-, 
Eonnels institutions^, decision makers^ and supply and demand, 

4, NIE-^ls neither tha only not thp largest source of binding for 
educational R&D, Thus, on the on& hand , NIE could attempt to^ 
increase its leverage through coordination and orchestration ^ 
^ith other agencies to achieve multiplier and synergistic effect^ 
On the other hand, NIE. budget allocactons might focus on gap 
filling in areas not fundpd by other agencies, Xhusj it is 
possibla for tfha NIE budget to reflect cross-agency opportune 

' Ities as i^ell as'NIE priorities and levels of effort, 

5, Consideration must be given to the minimal (floor) level of 

f funding needed to maintain quality and stability within a fund- 
tio'^ij and to the mfilKimum (ceiling) level of funding that can 
be absorbed by a funccion (given itsS Gurrent state) • As we will 
^ note,. 'fesearch system building rates and the ability to spand 
furids prodyctivaly is liiriitcd by the - extent of the exist iiig ^ 
centers of eKellenca- -^latedly^ fuuding Lav ^yatom ibuiWlng 
may neGd to bo concentrated rnthor than ycattered :^Tnund. 
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To iliustrate how these budgetary parameteri might be applied, 
let ui consider ^at a "balanced" funding process for Research, 
Revelopmeht and Qissamlnation might bsj given the existing state of 
these system fiinctlohs- 

As we notetfp a^ relatively large amount of funding has been pro- 

^ ■ . • . - 

vlded In the past for Development, while Probrem-Focused Research / 

_ . ■ • ■ . . -\ . ^ ' 

and (until recmtly) Dissemination has been relatively, less developed 

Thus, a "balmced" budget plM nd.ght bei ^ ' 

' i 1. Since there are now a sizeable number of Development 
products available, reduce current Development^ fund- 
" ing--to that miniTnal level necessary to maint.ain the 

existing high quality centers, 
2. Since Dissemination has ^^»Bn so ^"ee^ntly fragment- . , 
ed, direct significant ^uridlng to Disseminatlon-^but 
not so muph as to build a system %hat would overwhelm 
Users, At this tittie, quality control, sorting and 
technical service would likely need to be a part of 
the .function. _ 
. 3* Since ^Brge scale ^roblem--Focusad Rasearch has been neg- 
lected, provide major funding here "for sy s t em building 
but not at a level greater than thfe capacity of the 
fuyiction to abeferb productively.* J| 
4*' Provide moderate funding for Basic Research^ for long- 
term system-^building purposes 

i 

i 

^-4. A funding strategy such as the above would , of course ^ have to 
consldar existing funding realities, political cgndifiioni and the ^ 
particular current needs of Users* _ ; 

. Additidnal considerations will be important for such a ^ " system ' 
bui^y.ng" budget and policy orientation . - For eKample: 

, 1, There must be funding stability 'over time . System 
building is a sustained rather than an '■in-and-out" 
process* A three to five- year period would be minimal 
for gny kind of system b«fiding--^ft would be com-^ 
. pletely inadequate in the Researah function. For tota^ 
\^ system building^ a much longer tlin^ toame is requlrad. 
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2- System building is different froni procuremetit of a product ^ 
/ and this fact has significant implications for funding . , 

poiicies. For the procurement of a product, of^n competi- 
tive bidding is often a systemicaily valid sti^atagy because the 
product (not an institution) Is the CQncern* In system balldin 
ing, tha revprsa holds true^-the institutional (and personnel) 
base is the primary concern-^-'not "a product » 
3. From the political point of view it may be vital to attempt to 
educate the rale yant coimnunltles as to the state of the edu- 
cational system and to the fact that the next few years 
have to be seen as a period of long term capital investments-^ 
^ If we are not to be burdened in- the future with the errors of 
the past as we seem to be today* Perhaps this is the only 
meaningful Justification that can be used for added Agency 
funding that will not return to plague educational K&D In the 
near future, * , 
These last points warrant further p^nsideration* As we will note in 
the analysis s system building requires continuity and concentrat Ion * Di-^ - 
reqtion and orobestratlon must be provided from some system-wide agency . % 
such as Nil. ThuSp Agency efforts cannot be scattered and non-direct Ive 
and still be effective, ThlSj in tum^ implies a^ tighter degred^pf selec- 
tivity and control by the Agency than would be possible under standard RpP 
and competitive bidding procedures* Thus^ there is a dilemma --there are^ 
legal and political constraints Involved in a "gol^source" approach (which 
would be a relevtot mode of funding for system building, purposes) # 

Thus, as our analysis will Indicate^ it become? important for NIE to" 
know whatf is needed^ to be aware of thp legal/political constraints, ana to 
find ways to mediate the tension between needs and constraints-^i,.e, , meet- 
ing the needs without violating the constraints* Perhaps one mode of such 
mediation would be for NIE^ acting In consort wlt]^ other agencies facing 
the same tension ^ to apptise the Congress and other relevant groups of the 
long-term requirements for system building as contrasted , to procurement 
approaches to funding, given the current system sriate and needs* 

In the above dlscusslonj we have touched upon two"%ther Issues relevant 
to Nil which .are discussed in our analysis 1 inter ^agency coordination and 
internal NIE staffing {especially the question^ of an internal ^NIE Research 
capability) , . 
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Although a detailed analysis and discussion would be beyond our 
eurrent scopa of effort, our analysis indicates that inter-agency 
coordination and orchestration is a key Nil rola--both because NIE is 
the lead agency in educatlQiial R6^ arrf b@caus0»raore funding ©£ «duca- ^■ 
tional R6JD is provided outside of NIE than by NIE. As tge noted 
earlier, this may at times mean that a significant portion of NIE 
efforts may hm applied toward a specific critical area even though 
relatively little of NIE ' budget Is applied to this same area. Stated 
another wayj NlrE^s focus of concern should be with needs, not only with 
the implications of Its budget per sa. 

Our analysis also suggests that the way NIE provides, for Its 
internal staffing will have a critical effect on the direction and 
effectiveness of the Institute* For example, the NIE role of orches- , 
tration requires personnel who have skills in orchestration and in 
facilitating collaboration between people and/or between institu- 
tions and age^ig^es. Additionally ^ NIE will need soma personnel who 
have "political sawy^'^; For another ex^ple, qur analysis will 
suggest a need to build' the Research function and will further sug- 
gest that only by having an i^ernal Research capability will NIE be 

. ■■ — - ^ ^ 

able to orchestrata the building of the Research function^* 

We Mght also eonmt^.nt briefly on the Issue of NIE "rules of 

■ .J 

= ^hufflb - ( su^h = ^g=r^^"-on iy =of fer^ m= -grants cOTipet iti on" i^^n ^ a ^ tot a 1 a^~^ 
one million dollars can be provided and when you cai^fund 25% of the 
prpposals submitted")* We would not be concerned with the amount 
and the percentage figures per se* Rather we would note that there is 
-an inherent system logic in such a rule of thumb— i.e.j it is correct 
that the expectations of the field shouLd not be raised beyond 
reasonable levels o£ potential for fulfillment. We would further 
notes however 5 that "rules of thumb" tend, too often to fall into the 
trap of ignoring critical system or function dynainicSp conditions , 
needs and requirements . In the above case the danger would be that 
such a grants coinpetition would be used in an area so lacking in 
EKcellence thit the funding of 25% of proposals at the one Vnillion. 
dollar toual level would tend to trap the Agency into indeed provide- 
ing the funds/ to low quality, 1ow*^uccgss -probability projects . 
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One final comrnent. Our analysis may at . first glance appear overTy-- ^ - 
extended for such a "simple'^ problem as the Field^Initiated vs* Agency- 
. Dj^rected Issue. Our point is precisely that thia is not a simple questiQn-- 
ib^ia embedded "^ithin other more fundaniental system iss^ues^ and NIE*s re- 
sponse will have system-wide impact, ThuSj the only appropriate analysis is 
a system analysis. Additionally^ this analysis has shed light on other 
is^es confronting NIE^-^a good illustration qf the --multi-purpose effects" 
concept we will introduce in this report. 

111, REPORT ORGANIZATION AND PREPARATION 

'In the pages that fallow^wOur report will: 

1. describ'e our method of analysis; ' 
2* analyse the NIE/field relationship issue from both the generic 
and educational context perspectives in four major functional 
areas of educational R/D&I--=Research5 Development^ Dissemina- 
^ t'ioni and Evaluation Rese^ch; 

3. outline potential implications of thte analysis for NI-E pol-- 

icies and strategies in each of- the four functional areas; 
,4. provide hypothetical scenarios to illusti^te the imp 11 cat ions 
^ of potential policy and strategy decisions of NIE, 

The policy analysis is framed within the overa^ll contextual issue 
of the relationship between a mission^oriented federal agency (NIE) 
and the operative R/D&I community in a specific sectoral context (edu^ 
cation in the United States). The specific issue of Fi^ld-Initiated 
^vs. Agency-Directed Procurement is treate'd as a sub-Issue of the Larger 



Agency/Fie^B relationship issue, 
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This policy analysis has been prepared by staff raerabers of the 
=^ North%^estern Univera^^^^Hter ^f or. the Interdisctplinary Study of 
Science and Techaology under contract # NlE-G=400-76-0110, 

The Center is an interdisciplina]^ ilesea^ch center tljat exists 
to focus the broad and variad interests ibf a number of Northwestern 
University faculty concerned with the morale philosophical * cultural, 
social, economic, and political significance o£ science and technology. 
An area of special concentration is on RfiD raaftagament syst|ms and 
problems as they are encountered in a variety bf sectors Cp-g** 
dustry^ law enforcement/ anfl education). The Center brings together ^ 
interdiscipiinary talents from such diverse fields as management, 
econoinics, history^ philosophy, education^ journalism, the^physical and 
biological scieijces^ engineering, psychology, sociology, anthropology, ^ 
and religion. Faculty and staff associated with the Center are drawn 
from several organisational units of the University, including personnel 
with appointments in the Graduate School' of Management, the School of 
Education, the .College of Arts and Sciences, the Technological Insti- 
_ tuS_o anH others. Center Associates are affiliated with universities 
and Research institutes across the country and in a number of* other 
nations. 



* 

. 46 8 . • , 

\ ' ■ . ■ 



m 



443 



TABLE OF CONTENTS 



PREFACE 



1 



DEFINITION OF ISSUES AND METHOD OF ANALYSIS 



1 



RESEARCH . . 2d 

DEVELOPMENT ..... ....... 70 

DISSEMINATION ^ ^ - ^113 

EVALUATIOft^SEARCH , .172 

SUfmRY ANALYSIS ACROSS FUNCTIONS. AND CONTEXT: 

IMPLICATIONS FOR THE ROLE OF NIE . . . s- . - - ^ 204 

SCENARIO ANALYSES ^ ^ ^ = — ^ -242 





< 



469 



ERIC 



- 445 



DEFINITION OF ISSUES AND IffiTHOD OF ANALYSIS 



ERIC 



470 



- 447 - 



DEFINITION OF ISSUES AND METHOD OF iWALYSIS 



I. ISSUE DEFINITION * 

1, Initial NIE Concerns 

2, Our Reformulation of the Issue 

3, The Relationship of this Analysis to Current NIE Analysis of 
this Issue 

A* Review and Interpretation of the Duffy Report 

B. Our Approach 

4* NIE Purposes . ' . 

A. The Multiplicity of Purposes * . 

1. Substantive outputs of the R/D6I system ^ 
=2. System capacity building 

3, Affecting the system environment 
Manifest and Latent Purposes 
C- Interaction Effects 

5. The Functional -Context of NIE Purposes - V 

Research 
. B^ Development 

C. Dissemination/Implementation/Utilization 

D. Evaluation/Policy Research 

6. R/D&I System Context , ^ 

7. ^ The Spectrum of Agency Behavior ^ 

A. Types of Behavior ' v> . 
1* Pjo cur erne TXt s ^ 

2. Non-proQurenient system behavior / 

3. NIE internal actions . . 

B. Types of Strategies 

2, Degree of Agency involvement ■ 

3. ^ A s.tr^egy continuum- 
8/ A General Analytical Model 

II. METHOD OF ANAL YSIS 

'1, General Methodology 
2, Specific Analysis Method^ 

A. ^Functional- Analysis ^ 
\, Generic characteristics o£^ the function 

2. The Educational context of^ the function 

3, Implications for Agency behavior 

B. Cross Functionai Analysis ^ 

C. Scenario Analysis 



FIGURES 



Appropriate NIE Sehavior as a Function of NIB Purposes and 
the R/D8I System Context \ ^ 



2. Simplified Analysis Matrix 

3. ' Scenario Analysis 



* . 471 



= 449 = 



DEFINITION OF ISSUES mu METHOD OF ANALYSIS 



ISSUE DEFINITION 



Initial NIE Concerns 



As presented to us by NIE, the concerns of the Agency focused on 
two questions of procurement policy, F(^emost was the question of 
deterniining the appropriate balance between "Field-Initiated'' versus 
"NIE^Directed" The Agency had been receiving considerable , 

criticism from the field, reflecting the view that .too limited a role' 
was permitted the field in the design of either broad programs or 
specific procurements. Many of thq^se unhappy with the present charac- 
ter b£ procurements were suggesting that the Ins-titute commit itself 
to a predetermined funding percentage' for^ field-initiated R5D. The 
expectation was that such a predetermined set=aside fonnula would 
create a larger flow of funds into field-initiated work than had recently 
be^^he case. The National Council on^Educational Research^ in its 
desl-irey^y be responsive to^ the field, requested a review of NIE procure- 
ment policies and some careful consideration of the question^ of. how 
Agency policy might be developed on the matter of the appropriate 
balance between Field-Initiated and NIE^Directed R5D. 
" seconff; rerated ques't^iOT"inv61ved"di^^^^^ appropriate 
mechanisms for procuring Field^Inl tiated and NIE-Directed work, Of 
particular concern' were questions about the nature and extent of 
direction that an agency could justify building into procurement 
mechanisms, specifically with the requirements and language of RF^ s 
(as these might constrain project conception, design, execution, etc.) 
and most particularly whether the RFP should bo used at all in tlie 
RSD funding context. 

2. Our Rofoi^ mulation of tlia Issue ^ "H/ 



In thinking about these c[uestions, wo were struck by the rathei' 
fundamental and broad= ranging implications of the questions raised^, 
especially wh,en viowed fi*om the framework of our understanding of RuD 
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systems and processes. In order to deal with these far-reaching issues 
in a meaningful wa/j it seemed to us that there were some critical 
prior questions to be addressed and clarified. Therefore, we proceeded 
to reformulate the questions of concern to the Institute in d manner 
that we felt would best permit us to shed some light and suggest sonie 
directions for policy development. 

Our consideration began with recognition of two defining features 
of the Agency's character: first, that NIE is a mission-oriented R^D 

agency; and second, that NIE is the lead agency for federal activity 

/ _ - -■ 

with respect to Research and Development in education/ Given that 

role, its funding policies would have to be urlderstood in terms of its 
purposes as these impact on the total education sector'*s Research, 
Development and Inno\/ation (R/D^l) system. IVhat the balance of differ- 
ent typesL of funding should be and how an agency should relate to the 
field with which it worked would depend on the purposes" the agency was 
trying to achiev^e across all aspects of the R/D5I system. The nature- 
of this behavior' would need to be fitted to whatever it was necessaiy 
for NIE to do if it were to achieve its mission in all its R/D^I system 
aspects. Percentage of field-initiated programs arid type of procui*a- 
ment mechanism used could be viewed in this light as indicators or as ' 
symptoms of Agency/Field behavior rather than as direct policy lever- 
age poin_^5. Therefore, it seemed to us, our anaiysis couldT'be Focus'Cd^ 
most fruitfully on more furidamental questions concerning NIE's mission 
and purposes in relatio^n tOw the field's needs and conditions . Answers 
to -these prior questions, if seen as det^jmii^nts of nece,ssary Agency 
.behavior, would suggest what the appropriate Field-Initiated/Agency- 
Directed balances should be -at- any particular time, and would suggest,^ 
too^ the most appropriate procurement mechanisms, for each individual 
case. ^ With this set of assumptions a§ oi^j starting point^, we-^.hen 
began to formulate our analytical strategy^ - - ^ 

3. The Relationship of this An alysis to Curre nt NIB Analyses of this 
Issue ^ " 6 ' ' i 

In carrying out our analys^is ' the results . of recent in-house NIE 
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efforts (specifically the Duffy et_ bI^ 1976 memos) were made available 
to us. We deem it appropriate to point out the areas of similarity 
and points of departure between our analysis and the NIE in-house 
report. 

A, Review and Inte^retation^of the Duffy Report 

From our perspective, the NIE study was a richi ori-target 
discussion but one that was acutely limited by its narrowness of focus. 
We make this criticism on two grounds J 

a) The report lacks an overall R/D&I systems perspective, 
casting its arguments in terms most relevant to the Research function, 
but far less appropriate to the NIE purposes With respect to, and the 
generic issues Inherent in, such other functions as Developmentj 
Dissemination, etc, 

b) *The discussion was, in our view, more than necessarily 
couched in termS' of a Field/Agency dichotomy (an "us" versus "them" 
perspective). Rather, it. will^ as we will show, be vital to recognise 
iNIE's integral place as a part of the educational R/D§I system- Despite 
these criticisms we would be remiss if we failed to comment on the 
quality of the analysis within the above stated constraints. 

B , Ou^ Approa ch ^ ^ . r. ■ 

- ^^^^^^^^ ^-=-.^^-. ^_ . _ * _^ _ _ 

By contrast, our appro a cTi grows ^'out'^o'f affd^^uild^s"qflra^ syST'eiTfs"™ 

perspective, with NIE's mission being viewed in terms of its "impact, — 

as an integral part of the system, on the educational R/Dtl systam's 

health, functioning and outputs. Further, growing out of this system^s 

perspective,, and, as is inherent in our general analytical method, we 

engage in a broader, more systematic analysis of R/DSI functions and 

the range of conditions affecting the system. Final ly^ we note that 

procurement is but one of the range of behaviors available to NIE by 

which it can influence the system and that behavior must be evaluated 

in its total ity» , 

Thus-.„the essence of tfio^^^Mi^ as we- see it is: how does NIE 

achieve its purposes through procurdnvents and other Agency actions , ^ 
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taken in consort with and as' part of th'e field? , 

4 > NIE Purposas ' . - . 

a/ The Multi plicity of Purposes / 

= — ^ — ^ i — ^ — — - — '■ — ~_ — 

Central in determing NIE's proper modes of behavior must be its 
mission in relation to the^ educational R/D|I system. IVliile NIE can be ^ 
conceived as seeking inany individual goalsf- these can be usefully grouped 
. under, the following general systems dimensions' 

1. Substantive outputs of the R/PSI system Cknbwledge, products,/ 
services^ etcO ^ The systems throughput dimension. - . 

2. System capacity b uilding Cinstitutions3 linkages, personnel^ 
etc.) - The level of maturity and capability of the system 
itself. ^ . / ^ ' 

3. Affecting the system environment C^upporti prestige, legiti- 
macy ^ etc. 3-^ ,The system environment... 

Procurements tend to be thought of primarily in terms of the 
first of these categories/ the direct purchase of R/D5I activities to 
generate knowledge, produce programs, products, etc., or to provide 
services. Occasionally^ agencies procure capability-building activi-; 
ties directly, as in the provision of institutional support^ or the 
funding of training programs or graduate or post-^doctoral fellowships. 
But for the most part, procurements are designed and managed by 
agency^ersoTinel as individual projects or programs designed to pro - 
H^duce specific outputs for the use of the operational system or the 
R/DBI system its'elf . 

What tends to be overlooked is the extent to which these mani- ' 
festly single=purpose procurements tend to have multi-purpMe impli-*- - 
cations: in almost every procurement (or other Agency behavior) , inore 
than one of these purposes will be involved^ whether irifplicitly or 
explicitly. ThuSi the aw^rd of a grant to an RID institution to 
support a specific project may also have an impact ori^^^S3|^ii^^tutibn's 
capacity to perform in* the future (e.g. by permittingj 
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additional personnel, by the added ©xperience that, may result) • 
Similarly, the provision of an instftutional support grant may result 
in th^ conduct of R&D programs whose qwtp'uts may not have been specie 
ficaliy sought but which are of considerable value, and at the same 
time act so as to increase that institution's legitimacy vis, a vis 
vatious of its publics. ... , 

Consequently, it becomes essential for an agency to be very clear 
about its ^purposes, those entailing system building and affecting the 
system environment as well as the use of system, capacity no produce 
substantive outputs. And too, it seems important to develop some 
recognition of the legitimacy of latent as well as manifest purposes 
for procurements as well as other Agency actions. 

B. Manifest and Latent Purposes ' 



The legitimacy of latent as well as manifest purposes of Agency 
actions is a point 'that merits some elaboration. The manifest reason 
for supporting a particular project may have little relevance to the . 
real reason, which is latent, implicit, and infrequently made cleaT 
to members of the Re,D coimnunity and/or relevant publics. A particular 
project may receive funding npt so much because of the immediate 
payoff ekpected from the project itself but rather because of the support 
^it-i s^^pr^widing^ _f g^.=a..aari ain typf -g^oup^^f -- gra4uata^^*udentA^ ' 00^-^^^^^= 
because it is expected that if a certain Researcher is supported long 
enough he is bound to make very sub-stantial contributions to the^fdeld. 
In such cases, . defonding a project in terms of its manifest purpose 
may be difficult, but justifying it in terms of long-term capability-^^ 
building needs may be much less of a problem. Or to consider a some- 
what different example,- an agency may be subjected to considerable 
pressure to support a particular kind of program, and the ^pressure 
i^ay bu substantial enough to. have serious enough ramifications to 
jeopardize achievement of important objectives. In such a case^ an 
agency may have little interest in the manifest pur|iose of a project, 
but may .support it for thG^ latonf , purpose of relieving undue stress 
on the syste^i. ' 



The essential point here is' that procui^ements flfiay provide the 
greatest long-range payoff if they are designed with multi-purposes iii 
mind^ and if Agency personnel can design .th;0m creatively to" serve 
latefit as well as manifest purposes: IVhat .would seem to bp*^n6§ded, thei 
are deliberate Agency strate^gies to capitalize, on the multiplicity of 
consequences from specific Agency actioiis,' to maximize, possible gains 
and minimize possible costs from poter\tial multiple and interaction 
effects Across the latent and manifest 'purposes of given procurements, 

C, Interaction Effects; ^ V 

This issue of interaction* effects is one of the most critical 
points that "sa ems to be overftbked in the development of' Agency policies 
Once an Agency comes to view its^ behavior in terms of interactions ' - 
among seemingly discrete actions^ an entirely different kind of 
imderstaAding eifne4ges qi the potentially- fai'-'reaching systemic impli- 
cations of indivi^al decisions,%and "policies . Different purposed can, 
interact with one anot'hd^ '(a point we shall return to shortly). Pur- 
posQij can .interact with procurement mechanisms e,g#, a mechanism* 
used to procure Basic Research outputs can have major implications 
for long-term'bapacity-building. Purposes .and mechanisms cSan^nteract, 
with contextual conditions 5 e.g. , the state 'of development of the 
^ystemT a s trategy ,^^at ^may ^aue ¥een' iheffectxvp a^ec¥ffe„ ago "may "Be^ 
h'i^ly successful in achieving* certain 'pu^oses now 9f ten years from 



now,. ' ' 

. ' _ / ' , - ' ■ ^ ^ . 

The point is perhaps made /most clsearly by examining potential * 
f '\ ^ ■ , ^ - , 

interaction etfcqtsafflong purposes, both within a single procurement 

and^ across the totality of procurements m&de by an .agency, A procure-' 

ment can lead to the creation of outputs and^lead to an ihiprovCTient 

in the system environment . Or, it can lead to a deterioration in the ^ 

environment if, for example, that particular output is se.en as ^, / 

offensive to certain key elements,^ It could also lead'' to a d^truct^pn' 

of ^R/DSI system capacity by, for example, moving 'critical resources ' 

"■ ^ ^ ' . \ ' ' . ' _ \ 4 ■ . . • ' , " ■ 

away from their., most prorfuctive areas of application. , » ^ 

, ^' . ' ^ ' - ' . ' f ^ ^, * _" . " ^ 

When^one ejcamines patterns . of Agency actions across,^procurem@nts. - 



i.e/i when one considari potential interactions among the di'screte 
procurements that make up an agency's ''portfolio" interactions' of 
iW^eV^n less obvious nature* become apparent. Across progrfens^ the 
outputs may reinforce each other (synergistic effects). Or they may 
cdunteract aafch other in the marinar of what might be called "i^ti^ 
purposai**' -- i.e., taking specific action in pursuit of one purposa 
may make* more difficult the achievement of anotjier purpose. The use 
of RFPs to procure certain kinds of Resea^ch^, for instance, mght ^\ 
well have anti-pwpose effects if a by-product is turning off the 
best Research talents^ suggesting to them that Research funding in 
the field, of education is unlikely to be forthcoming without to'tenable 
constraints. Such effects may be, immediate in their Interaction or 
observabla only in^ lagged and in second- and third=order manifestations 
If an agency decides to design procurements that are deliberately J 
roUlti -purpose in nature, it becomes essential fpr *agendy personnel. to 
hwe a clear understanding of the kinds of procurement ''add-ons" that 
tend to be congruent vs. incongruent with earti other, /functional vs\ 
dysfunctional. . 

Portfolio effects may be discernible within iifctitu^ons %% well 
■as across institutions. It is common to observe how R5P institutions^ 
becoihe shaped by the patterns of funding that become available to them* 
If a single ageftcy provides a particularly large share of an organiza- 
tion?s total fundings agency actions can have the effect of moldings 
or changing the very character of such organizations.^ , 

\j\ summary, then, interaction effects will need to be considered 
in' terms of their: - 

- synergistic effects ^ . 
congruency/incongruency with each other 

- lagged (and indirect/second and third-order) effects 

, ^- cumulative effects within ^nd on institutions and -^personnel 

The 'essential point is tJiat multi=purpase effects are inevitable. 
The issue is not whether there should be multi-purposes but rather 




whether they are to .be recQgnized or '^ignored, and if Tecognized to /be--' 
dealt with and capitalized upon or anti -purposes minimizad, 

5^ The Functional Context of NIE Purposes ^ 

up to this point, we have considered three sets of purposes that 
can be affected by procurements and other^Agency behaviors . We turn^ 
now to consideration of the second ma J or building blocli of oufUnalyti^ 
cal appro aifch; . \ , I f 

- NIE's pu]qp03es are aclfifeved through the carrying |out ( 
activities that cin be categorized by R/DftI functions: 
Developnifent, pissemination^ : etc. Achieving the •same pi 
institution building or affecting the system enviroi 
different Agency behaviors in relation £o Jthese diffea 
Building^Besearch institutions my demand strate^gies 
from those required to build Developnient organizations 
that are appropriate^ for procuring Development products, may be quita^ 
inappropriate for procuring Basic Research studies, and so forth, , . 
Similarly, the«types of skills and experience; required within NIE 
to work with personnel and institutions involved in Basic Research are 
likely to be rather different from those required when working with 
those involved in the Dissemination function. Therefore, it follows 
that the determination of Agency behaviors (of all kinds3;rare. likely 
to be highly dependent on the R/D5I functions with which they are 
iiVtolved- and this consideration must be reflected in our policy 

analysis, " . . " i / 

To make such analysis possible, it was necesaary for i us to select 
a set qf R/D51 ^functions that seemed to be reflective of the bulk of / 
the activitles/M^t go on within educational R/D8I and that become the 
object of NIE .procurement and other Agency activities. With this in 
mind, we selected the following R4D51 functions (or groupings of 
fimctions)to become the. focus of our analysis;* . 



* In the R/DSI systems analysis scheme we use generally, we treat Need 
Identification as a discrete ^nctionV In Iducntion, . however , where 
specialized ^Need Identification mechanisms tend to be lacking. Need 
Identification is carried out as an integral part of each function. We 
have therefore treated Need Identification this way in our policy analys 

•* 
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Research 



Rassai'Qh cm vary along, a series pf multi=dimensional continua, ^ 
geiibrally categorized as going from Basic to Applied.; We^^^lly _ 
reCDgniza ^e debate invQjved in such categoriiat^^ &f£i- 
ciiltias involvod in the u^ual over-siD^ltHcation so it^ Never-^ 
theless there are^ftir bur piirposes in gelation to dlsc^kirtg. appr^ri|it# 
Agency behavior i important potential differences between what is ^ 
requiMd to dekr with Basic Research^ which is largely involved in theij 
search for knowledge for its own sake>' and what is required for applied^ 
work that goes on in relation to well-defined problem areas* Wf will 
therefore axamlne these two tj^es of Research ^asbeiiig represent at iya ^ 
of the range of activities with which NIB may bacome invdlyed. In^ ' j 
think|ng through the i^lications of our analysis for the partlcula^". ^ 
kinds of Research NIE procur,es, Agency personnei can make the nacas^axy 
accommodktlons to variations eYicoimtered between these two extemes// 
Thai two sub-functions therefore will be^ . ^ ; 

'1^ jasic Research (the seeking of knowledge for' its own sak#), - 
^ 2. ' Problem Focused (ot Applied) Research . As used here and j : 

later in this analysis "problem** refers to a social or* ; , 
practice=^centef ed prdblem rather than' to the kind of v ^ 
intellectual or dis^pline-based problem that is central 



Jl 

J- 



to Basic Researeh. 



B. Development^ 



Whereas what we'are tailing Problem^Focused Research is oriented 
toward problem areas within education. Development work tends to be 
focused on the design and elaboration of products^ processes^ programs, 
prdcedures, practices/ etc. that attempt to deal wi^ identified 
problems or needs. For' simplidity of usage, we will generally use the 
term "products*' to describe the outputs of the Development p:fOcess . 
Hbwever/ it should be understood^ clearly tbat we have-the full array 
of Development outputs in mind programs, procedures, strategies,: 
practices, etc. as well as the narrower category of outputs generally 
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thought o£ as "products." r 

G, Dissemlnatlon/Ifflplamentation/Utllization ^ 

* ■■ ■ *■ " ~^ . ' ' * . 

The functions within this ^cluster are typically traced separately 
"in R/Dftl syitems analyses (at least as between Dissaminati^^ ^ 
other two). ^\ie will link thein in this an^ysis since *^hls is a : 
charactaristic of the educational R/DSI system: its relatively low , 
lavel of maturity and "the general /absence of institutionali zed integral 
User change agent functions ^bake this a .necessity. The focus, of , our.? , 
analysis will be placed on tlie Dissemination f^ction^ since it isjhere, 
in system- level linkages (rather than within the User setting that 
shapes Implenientatton/Utilization)^ that NIE efforts can h^ve more 
substantial inqsact/ However, it shouW be noted that any future ex«. 
pahsions of our analysis should involve specif ic'detai led analysis of - 
the rn^lementation/Utili^ation functions, " 

D. Evaluation/policy Research 

Evaluation and Policy Research are often grouped tpgether. In 
education this seems particularly fitting since Policy Jlesearch in 
Jducation so often, involves one or another form of Evaluation Riesearch.. 
However, there are in^^ortant differences between Evaluation Research^ 
and Policy Research, and they may require some extended separate / 
treatment. Since it appears that the bulk of NIE's efforts in these 
areas are mor# directly involved with Evaluation ResearcK, we* will 
focus on this function in our analysis. Again, further work could ,^ 
ejqjand on the specific issues related to Policy. Research., - 

6. R/D&I System Context ' ^ / 

We have seen up to this point in the analysis that achieving the^ 
same Agency purposes may require somewhat different Agency behaviors 
in relation to different R/Dfil functions. But beyond this, for R/Dfil \ 
functions and their generic requirements to be understood in terms . 
that seoni congruent with concrete emp^pican reality, it becdjies im- 
portant to see each function within, total R/DSI system context. 

4yi 



We define an R/D|I^system context as the joint interaction of 
three elf mentsr . / 

^ . I ^ /\ / : ' • "• / " ' ^ . ■ , ■ ' ' ■ ■ . . ' • ' ' . " 

■ 1, tha'R/DSI functions, as described above * 

2r operating fconditioni within a particular R/DSI system 
- , ^Cf^gi^i the_ aatuirtty of the syateipi the^ types and|[qu^ity , 
^% of personnel aval labla'l the types and quality q£ the insti- 
tutions available; the state of developinent of the know- 
*\ ledge/technolo^ basei the nature of the information 

systems and flows among key elements in^j^e R/Dftl system-- 
b Journals, invisible colleges^ conferences, etc, etcj the 
vary nature of the innovations involved)* ^ 
, ' 3^ the systei)! environment (e.g., the politici.l/social environ- 
ment/ especially its supportiveness or lack of support for , 
the system'^the economic environment; the nature of the 
knowledge base 0f the field whether it is a natural-' oi 
; social-science base; etc.)/ 
Therefore, in dletermining appropriate Agency behavior for achiev- 
ing a ^certain purpose it becomes vital to be cognisant of both ;^e , . 
system function to which it applies and the manner in which the generic 
characteristics of a given function are mediated by syitamic and 
environmental conditions. It is this joint effect that we term, the ; 
R/DSi systett context. ' ^ _ 

" ' * : ■ ^ V ' • ■ : ■ ■ ' ■ 

7, The Spectrum of Agency Behavior . 
/ . A. Types of Behavior • ^ 

While an agency such as NIE can engage in a wide variety of be- 
havior in relation to Its^purposes, thesa can be usefully grouped for 
analysis under three headings- , 

1 , P ro curemen 1 5^ " • 

An agency's usfe of the funds kvailable to it to procure specific 
outputs, institution building, etc. is genially seen as the prime 
fprujii . for Agency action, . 

■ ' ... ': . 482 



2 , Non-Prdcurement System Behavior - * . -. \. [ . 

The potential range of Agency behaviors is-inot necessarily limited 
to procurfments. It may also play a potentially important role in the - 
system through a variety of other kinds' of actions . These may include* 
working with other agencies so as to a^ieve synergistic and .multiplier 
effects from Joitit (additive and/ or supplfmentary) activities i having 
its personnel play an- active role as mattBe^aof the R/D8I qpmmunity--^ 
as Researchers J as partici^nts '*in dbnferences, as inf luences gft ' . 
thinking in various Informal interact:ivfe modes^ etQ,;vby making in- * 

formation available; etc. , , » - ^ , 

• ^ •* . ■ ■ ' . 

3. ' NIE Ittt ernal Actions ' * / 

4 How 'an. agency relates to a field will be in^ortantly determined^ 
"b^ what goes on within the agency/ Specif icillyi the s.trategie^^ and 
modes of behavior required ^will be constrained by the extent to which • 
ME /h%s the number and type (skills^ experience^ stature) of personnel 
needed and the organisational and budgetary structures that pirmt 
appropriate behaviors. ^ » ^ 

B. T>^es of Strategies ' ' , ^ 

'Within the above three areas for NIE behavior^ there remains a 
. wide and multi-dimensional variety of behaviors in Which an/egency ^ 
can engage/ These can be qondensed along three dimensions: 
' 1. Degree of Agency Control . 

NIE might see the need to maintain a greater pr lesser degree 
:^ of control over what goes on in the field, in terms both, of extent 

(levei) and of domain Cprogram selection/ methods^ used ^ personnel 
--Involved^ nature of relationships, forms of report ing, e tc. ) • 

2 . Degrfe of Agency Involvement / » 

/ ^ NIB might phoose to be more or less directly involved in what 
was occurring in the' field-- f6r example: NIE participation in the . 
various functions (e.g, , undertaking Various types off Research, 
pissemination. Evaluations, Ppllcy and RfiD system^ studies) ; planning 
for and monitoring of the R/D6I system- determining what work to carry 
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tfut internally and what activities to pfQcure through external coi 
traets or grants, J ^ . - 



' 3 > A Strategy^jCont inuiMfi 

^ ^ - --jl ' ~ ^ ■ . ' ^ -% 

Saen thri above ways, it ii possible to array very rQUghly th 
types of Strategies by which an agency ean relate to various ^aspects . 
of' a field* Suoh an array could^be the following^ ^ 

« Initiate activity for a field 

- ^Supplement ,what is already |oiiigF on 

- . Modify what 'is already i^going on j ^ 

^ \ - Select from -OTong what is already- in a field ^ ^ ^ . 

• Bducmte tf\e Afield to ppjerate differently ' • . 

- Mediate external pressures 6n specific field elements or 
programs ' - - ^ 

- Integrate programs, institutions .and systems td be found 
in the field , ^ / . 

Gooperate with other programs (e-g- in. other agencies) or 
Vith field programs , ^ . " 

; - FacilAtate activity already going on _ . 

, Execute activities, initfat^d^by the field ^ ^ 

Evaluate activities that have occurred in the field 
a - Monitor what is going on.\ . . " 

This array^ while admittedly rough, repreients, jdintly, a ^ 
diminution of Agency control and .involvement in what is going oh 
in the tield, in both p^ragma tic and systemic terims . Thq order is ^ 
not, however s especially important. To th#,. extent that it does 
a^ray a variety of possible strategies-, atctdemonstrates a richness 
that goes well bfeyond the simple Fi^id-Iniitiated vs. Agency-Directed 
continuum. From our'^erspectiv^,^ *the Field-Jnitiated vs. 
Agency-Directed continuum is .like^ to be most meaningful in 
relation to individual projects, and programs rather than system- 
based purposes aind in relation to those functions in which progrkmMtic 
activities can' be separated easily from system activities, at least, 
in the short riyn, as in the case of Research, especial ly Jasifi^Research . 



(And even then the extent to whlfch the PIS vs NIE cphtteuufli a^ppi^^s 
saems related to the extent to which Agency personnel foom on their 
own individual projects rather than the system as a whole*) The pl^l^i 
Initiated ys, NIE-Directed continuum if likely to biB far Ijss ineaning" 
ful for such inherently systemic ^^unctions aa bisseminatioiij or for 
V systam building piarjosas, Sean in thii way a detei^inatton tire' 
proper proportion of NIE 's budget' that should go to Field-Initiated 
activity could only be made in rejation to NJB's agenda^ ftJ it plsy^^ 
' itself out with respect to the Agency's .purposes^ manif^^^^d in 
the/variqus R/D%1 functions (Research/ Bevelopment* Dissemination, 
under the prevailing contextual conditions Cpersonnei^ funding, 
mf.turity of the system etc,). As an overall Ihdex it would therefof^ 
not seera to provide much meanings and hence not represent ^ Proper 
actionable policy criterion^* ' 

8; A General Analytical Model , ^ ' " ^ 

As implied above, our analysis will involye the specif icatlon 
the behavior appropriate to the achievement of Ag^r^cy purpo^^s in th^ 
context of the^fuhctional, ^systemic and other- environmental conditions 
- that prevail. Diff^ramnaticallyi this can be illustrated M in Figur© 
1, This model also indicates that NIE's purposes will themselves be 
influenced by what is going on. in, the educational R/D5I context and 
that in turn this context will be importantly influenq0d by how JJIB 
does actually beidavej as an integral part of the^ducational R/DSI 
system, * ^ ^ » 

II . METHOD OF ANALYSIS ' ^ ^ 

1. General Methodology , . ^ \ k> 

A complete analysis would require examination 0f how the intef^ 
action of NlE's purposes , as manifested in the R/DSI ^^nctio'^s. and^ 
^ mediated by the syst emic and environmental^ conditions , determine 
appropriate Agency behaviors and consequently strategies in ^relation' 
to tffe field, the above statement would imply at least a four 
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dimensional anarysisp As a'simpMfying stfp, we l\aya elected to 
dpnsider each of .the ^/P5I func/yons .separately in relation to the V^. 
combination of ^/Dftl s.>^steftic" and environinftntal cdnditiSnSi as shoWn/ , 
in Higure 2. ^ \ = . . ^ ^ 

SI EnviTonmentai Systemic bonditions 
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CAppropriate NIB Behavibrs/" 

' NIE Stt^te^ies) . , ; 



Fi^ira 2^ Simplified Analysis Matrix ^ ^ * 

The cells of this matrix 4re the appropriate NIB behaviors^ which can be 
^built into strategies .that the Agency could pursue. ^ " * 

Having conduoted the individual analyses for each r/DII func 
'it becomes possible to cohsider the iinplicatioris for^ 
across the functions . finally, the strategies can be converted into 
scenarios in which patterns of hypothetical, ,o.v' actual past or "con 
taifiplated NIE behavio^^ are analysed to suggest likely in^acts if" 
impi^ented as originally formulated^ or ''as refpraiUlated in alternative 
ways that take into account some of the points we have trie^to^ under- 
score in pur analysis. the final analysis, ona^tould' conceive of 
converting NIE's total progranmiatic agenda into an Tntegrated sat of 
scena^'ios, deteim^ning the various |fatterns of appropriate Agency 
behaviors (a fallout of which wouLd b*e an estimate of the percentage 
of all procurements that would be Field-Initiated--though as we have 
stated this, would not be an index of great significance in an oT?%itself) 
and suggesting likely impacts,^ ^ 

2. Specific Analysis Method ^ , ^ 



Within ^he framework of the above general approach, the procedures 
to be. followed fed.ll be as follows* ' ' / " , \ 




i 



— }, 



A. Funet tonal, Analyses ' r/ i \, 

. ^ Eacfr^jselected R/d§I function ; (Research — Basic aHd Problem-Focusedr 
D#valopmant, Ms^grairtation, Bvaluatioh) ' will be analyzed irt the follow- 
ing mannar: / ^ . r ,v ■ 

K - i. Generic Ch|iracteMstics' of the Function 

^ W^^ of those • 

genarlc Issues inherent in the filnction which ar# likely to/be of 
relavance to educatibnal R/DSI and have Implications for NI5 behavior*. 
A complete generic review of ©a^fe fiOTCtion wo||ld inevitably deal with 
many issuei that are of relatively Ifesser concern in educa-tidn at this 
timt * Given the constraints "Of iti^e, volume and salience i^lieiir^n 
a policy (analysis^ wa have atti^mptid ts be judicious_4^ "Sur sel^ 
of issues toVba dliciissed; . , ^-^^^ ^ 

2, TKe Educational Context of ^^-thC Functi * ' - 



I ^ We then conside!r the ci^Mnt s_tate of affairs inr the educatiGnal 

. ^ R/Dfil system as it relat^f to carrying out this*^ particular function. 

f ^ " ' " . ^~ ■ ' ' 

axamnp contextual issues pertaining to the state of development of, 

the relevant knowledge base, the institutlonal basej the personnel 

' base^f' th^ climate of support for funding its activitle3, eic. As before, 

the Implicatiohs for NIB behavior are drawn f Wliere feasiblej this 

section concludes with some general guidelines for NIE's . operating modes 

and strategies, - . 

\ 3. Implications for Agency Behavior - * 

In this final section of each functional anajysis we attempt to 

summarize the requirements for NIE^ behavibr i^ relation to- the parti- ' , 

cular function in its present context, buildup up some recommendations 

for Agency strata^* *' * ' % ^ ^ 

* B. Cross-Functional Analysis 

In this critical chapter, we take the -analysis and strategy- 
building a step^ higher by attempting to draw the cross-functioiial 



^\ implicaticrns for NIE at a total Agency level 

' ^ = . J. . ; ;^ , 489 : 



' C. Scenario Analyses > / * r ^ ^ ^ * . , 

Two illustr.ative scenarios bto then Analyzed* Each scewario' i 
consists of a description of & ^hypothetical NIE behavior . • " 

(e.g.'j a particular procurement program, its objectives ^ the manner 
* o£ its implementation) j an analysis cfr its wide implications (if jiny)^, 
and 'likely impact/ our recommendatioTif as to what phanges might 
(or should) havp been made, and the likely consequence of these . ' 
repommendations . The thinkinj behind'this process is depicted ^ 
graphically in Figure 3. . . . 

' A specific NIE action (usually a procurement), with its intended 
purpose, would rpfeult in some consequences* Tlie effects or impacts 
would be a cprisequence of the NIE action interacting with contextual 
conditions, and would have to be understood in terms not only' of the 
intended and manifest purposes of an adtion, but also any other 
(possibly latent) purposes. These impacts would be evaluated and 
appropriate strategy alternatives recommended* Such recdnunend^ions 
would lead to NIE actions involving procurement, non-procurement and 
internal NI^ behaviors^ in relation to the whole range of possible 
purposes* Then, in turn, the effects of these ^behaviors would- be 
analyzed, " ^ 

^ ^ The scenarios Tfe-ihte to suggest an analytical approach we 
view as appropriate for internal Agency use in designing procurements 
and relating procurement strategies to other^ possible non-procuyemenf' 
courses of action. The strength of this approach,. we would argue, is 
the manne: 
thinking: 



the manner in -which it orients Agency personnel toward syste^i-level 



, It requlrel the analyst to think in terms of the 

mulriplicity of pjirposes implicit in procurements and 
^ crttter Agency behaviors, and sug^e^ts the legitimacy of 
designing courses of action in terms of latent as wjell 
as manifes^^"^irposes . 

It requires consideration of interaction effects among 
purposes, between purposes and mechanisms, and between 
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pu^oses and generic clvaracteristlcs of R/Dgl functions - 
■ as these are mediated by systemic and environmental 

conditions. - ^ 
V 3.. Xt calls for Agency personnel to'estimate potential - 

impacts of cdntemplated courses 'of action on key dimensibns 
of the system. 

4. It suggests a series of questions that enable the analyst 
to generate alternative courses of action with' potentialiy 
different impacts^ and to use theie alternatives^, along 
with 'their own" estimates of potential impacts , to reformu- 
late and refine CQntemplated strategies. 

We offer the analysis which follows as a first-cut^ at what we 
believe can evolve over time into a highly useful approach. 

Puffin al ., 1976. ^ 

had accass to several internal memos ^ iti various states of their 
develppjnantj in August and September 1976, including: a) m August 2, 
1976 ^^^^o Written by Susan Duffy/arid Noel Brennan entitled "Status 
Report on FIS"; and b) a somewhat, later set of materials providing . 
workitig definitions of Narrow and Broad FIS, elaborating the relevant 
dimensions of each, and considering some of the implications for NIE. 
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STUDIES AND ACTION PROGRAMS ON THE LAW ENFORCEMENT 
- EQUIP^fflNT RgiD SYSTEM V EVALUATIVE STUDY 
OF THE EQUIPMENT SYSTBd imROVEMENT PROGRAM 



^'his prdject rapraaanta the initial mf forts of CISST to develop and 
utilize a contaxtual atialytical apprpach to r/d^I, Thus,' it was the 
precursor to the contextual a^nalytical frTOework we later flevfloped 
and which is presentad in thia report . 

^his project was a natlonwides 1-1/2 year empirical study of the R&D 

ystem for innovation In law enforcament equipment* The project 
rfequii-ed/Cin the first phase) that we familiarize ouraeivea with the 
law enf orcament^ context in ^o^der to obtain a general perapective on 
dhe key issuea ^that werg to.be* investjiatad ±n the. main empirical 
^riaae. In this first pfrase, we established a library' of several hun^ 
dred items (as well as accessing materials avalla^ble in the \North^ 
Western Urfiversity Transportatio^^ibrary) ; consulted with Bome 
twenty persons knowladgeable about law anforcement equipments and f;^ 
conducted survey research through" interviews and general queatlon^ 
nalres for ueeri%' prpducar^ and distributors of law enforceme|it 
aquipment* This initial phase of the rasearch culminated in a work-' 
shop attended by ESIP advisory board membars^ and NILECJ-ESIP par- 
aonnel ai well as CISST^ project members from all bver the couritry* 

The main empirical phase was conducted In the following manner*^^ Cri-- 
tical policy issues and apaclfic problems in the "law en'f oraamenlt 
equl^metYt RifD systam were identified from the research of the first 
phase and ware synthesiEad into eight issue areas* With the assistance 
of law Jnforcement aquipment specialists, ten law ,fpforcemant equip- 
metit items (representing a broad range of both law anforcement func- ' 
tiona and equipmant types) ware selected for intensive, ^n-depth case 
analysis in a matriK format across the eight issue areas. Interview 
survey questionnaires were t^en daveloped for producers ^ for users* 
and for intermediary organiEatlons and distributors. -Interviews were 
then conducted with: 71 of 111 identified producers; ^ 47 user 'organ- 
izations ; 12 intermediary or^ganlzations ; 8 distributors.. Interviews 
were conducted nationwide by CISST personnel l-ocated throughout the 
country. From thb su^ey, relevant R&D issues and policy options were 
identified in terms of the selected equipment types * the selected 
iaaue areas, and the, law anforcement R&D systam. * 
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PROJECT .MP PROGRAM DEVELOPMENT BASED ON A CONTEXTUAL ANALYSIS OF ENERGY 
CONSERVATION R/D&I SYSTmsr A POLICY ANALYSIS FOR THE ENERGY RESEARCH 
i^ro DEVELOPMENT ADMINISTRATION, INDUSTRIAL ENERGY CONSERVATrON DIVISION 



This ^analyi^ hds its origin .in an NSF funded project In cooperation with 
thaj^ivislon^of ^duatrial Energy Conservation of the United States Energy 
Reffea^rch- andv^avekopment Administration (ERDA) , The Initial objective was 
to demons trat^=^ie f easibilitypf u^ing the comparative R/D&I eystems 
framework developed in analyEing ^wo policy ^.issues in the area of indusT 
trial, energy conservation R/D&I, The specific policy'^ issues for dnalysie 

I were "defined by staff members of the Industrial Energy 'Conservation Di^j^- - 
sion of ERDA in cooperation with NSF's Division" of . Policy Research, and 

■ toalysis and the Northwestern research teamp These were as follows* 

/ , . 1, What are %hf?' energy conservation R/D&I system factors which. - ^ 
^ ERDA should consider In evaluating specific proposed new' 

^ " ■ . technology programs ? ■ 

2p What are the dimensions of- venture analysis (ar^"i®pact ^ 
^ - analysis") which ERDA shoulC consider in evaluating 

specific new technology programs? ^ 

This study is being organ^ged in two parts.. The first concerns Itself 
with the artalysiSi planning , "'"and Implementation of industrial energy 
Qonsarvation programs ; the second with the parallel flow of projects 
within these programs. A program is more accurately defined as an > 
energy conservation opportunity area* (ECOA) sufficiently broad so as 
to encompa$s several discrete projects, These- projects , in turns may^ 
encompass one or , more phases of the R/D&I Innovation cycle from Initial 
need identification to, final utilization. The projects ih a given ECOA 
may also vary considerably in the extjent to which they are linked 
together. ^ 

At the program level, the basic strategy of the industrial conservation 
affort is visualized as being fortaulated so that projects may be selected 
and contracts negotiated in accordance with ERDA objectives* Similarly, 
with regard to implementation , at the program level the 'guidelines and 
methods of executing projects and utilizing their results in industry are 
conceptualized as being developed so that at the project level they may 
be utilized to monitor and evffludte projects. This iconceptuallzation is 
roughly in accordanoe with the way the Division of Industrial Energy Con-- 
servation is now operating, except, that there is considerable variation' 
in the extent to which these phases*^, and levels of managerial and organ-^ 
izational activity are systematically' designed and Integrated in an- over- 
all scheme. In. essence, it has become a matter of developing a context 
tual system analysis at both the program an^ project level through all 
phases of technological innovatioii requiring an input from the Division 
of Indus' trial Energy Conservation, , ' 
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DESIGN/TESTING OF SURVEY ITE!^ ON ORG^IZATIONAL 
, ^C^ABILITIES FOR_R_/D€iI FUNCTIONING 



This GOTitraet required' that we dp the "conceptual . add design work and 
* some field testing for'a set of se^tbr-speclf tc suWay instr^menti 
to aasass levels and distribution of ofganigational capabilities ' for 
spacific kinds of' R/DM aetivifciaa , We conceptualized each of fou# ^ 
areas of R/D&i functions (rasaarfchj evaluation research, deVelopMnt, 
and dibsamination/utliizatiofi) in tems of kej diTOnalons useful for 
distinguishing §inong types of work raapondent organikations had - 
carried out, scale and Jcope.of operations within each txP® activity, 
.We than, designed sactor-spebif ic variants of the basic instrwnent"- 
geared to diff af ances .in functional emphases among sactprs surveyed 
(academic^ private ^ SEAs' and ISAs)%. Informal -field testing of the - 
instruments was conducted^ using respondents salected from thepe 
sectori* Based on the field test results, rtcfenmendatlons wara mada 
about: additional conceptual and- design work ^td be done;^nd 

(b) how the instrunients might be used in ^ re&aarch program focused 
on assessing organlEational capabilities for educational KPU and 
policy planning for systam capacity building^ , 




ASSISTANCE TO NIB IN PREPARATION OF 
' THE NCE^ ANNUAL KSPQ6T TO CONGRESS 



Under the terms of this Bhort-term contract, CISST personnel grafted 
'a chapter for inclusion in the NCER annual report to Congress, The 
chapter describes and assesses development of the educational R/D&I 
system* s capabilities over the paat two decades (its ins tltutibnal 
base^ personnel base, outputs, linkages to' educational practice, 
funding, knowledge/ technology base^ and R/D&I management/policy know- 
how) ; analyEes the current status of key R/D&I functions (research 
development, dissemination and ^ ^yialuation research); and suggests 
critical system needs that might be addressed through federal policy 
inltiati^ies . . ^ ' ) . - ^ . 
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A EOLICY. STUDY OF THE EDUCATION R&D 



DISSEM INAT ION AND FEEDFORWARD SYSTEM 



(RESEARCH AND DEVELOPI^NT EXCHANGE) 



Thla pfoj^ct/ involved CISST' providing ' cohsuitant services over ai]L appro- 
ximately five month period to a planning group^'jPor Nil's program for 
develop ing a Disaeminat ion/feedforward System (Research and Developraent 
Exchange), ^e planning' group consisted, of personnel frop NIE-aponabred 
^'educationaX laboratories ^ and centers and staff of NIE*a_ School Practice 
and Service Dlvla^lonj Dlaaemlnfatlon and Resources Group, The Vork 
required a .multi-pronged approach^ Including: cheating a conceptual 
scheme th'at wpuld aid NIE- and the planning group . in- analysis of the 
ayatem being developed , in Identifying critical 'laiuea^ and in genaratirig 
policy options ; meeting with and majclng-^puts to the planning group 
during their .planning meetings ; developing a' cinceptual^ scheme thkt 
would pemit NIE to 'monitor vthe healtK 'arid functioning of the system; 
devpl^Dptng an overall anaiy&la of requirements for .educational R/D&I 
dissemination ahd feedforward (using oar contfeKtual analytical frame- 
work); Jointly a^electifJg with the planning groujp a-, sub-set of issues 
for furthat in-depth analyala,; selecting 'and tnonltoring a group of 
conaultant% (wlthvckn'own expertise in the selected Issue areas )^t6 pre- 
pare analytical papers/on the selected sub-set of issues preparing a 
final report- in&egratlng the a^ove work, ; . 
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IMPLICATIONS OF REGIONALISM AS M/APPROACH 

TO /EDUC ATIONAL R/D&I: A POLICY MALYSIS 

— - ^ ^ . -- - ' ^ 

FOR THE NA TIONM. INSTITUTE QF^EDUCAXION 



Thla projaet (currently In proc^aa) la another project being done to 
illustrata the utility of the ClgST contextual anaiyttcal approach , 
for- policy analysis of i^saues of currtettt Importance to the ^National 
Institute of Education. The iasua-waa jodntly aelected by NIE and 
CISST* The analysla 'will require collection^and eKamlnatlon of 
currant activltlaa, pollclaa and other relevant matertala f roni 
various ac.tual or -potential p^y'tlcipanta In regionalized eduaatidn 
R/D&l (e.g*j Nli 5 NIE-$ponaored educational R6dD Labs, SEAs) and flrld 
Interviews with varioua partlclpante The prefect will require com- 
parative conteKtual analysis of the iropllcatlon of varl6us typas of 
regional approaches (e . g . : davelopm^tit/support . of Informal regional 
networks and collaborative* activltiea i creatlofi/support of NIE-fipou- 
spred ragtonal organlzatlona ; a^,) in relation to key teducatlQnal 
R/DM- issuea; In relation to specific R/D&I functions; In relation 
to the current state of development of the educational R/D&l system; 
In relation to contajitual operative conditions (e,g*: fundings the 
peraonnel bas<^s currently exlatlng educational R/D&I organizatl6na , 
legal/political envlromnental conditions) ; in relation to the mission 
of NIE. The -project will require development by CISST of the con- 
ceptual framework within which information may be gathered , contextual 
analyses may be made^ and policy/strategy implications may be made. 
CISST will suggest potential pollcy/atrategy options for consideration 
by NIE... > , _ . " ^ 
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A - CO^gREHENSIVE CONTEKTtJM: ' 
APPROACH ^TO PEVELOPMENT AND 
tHE ROLE OF TECHNOLOGY IN 
. DEVELOPMENT 



The issue ^of development has Been ^receivltig increaslTig attention over 
the past few decades from gov^erriments ^in .developiRg and .d^eibped ^ 
countries) J agencies and other organisations* A variety of inter- 
active causes'^ this interest/can be identifi®^? including increased 
population ( accompanied- by increased unempLDyjfle^i'^ and underemplo3^Snt) 
and c^<^raa^ei^ per capita ihcome' (accompanied by Increased incorrie dis- 
tribution disparities) . Other dynanilcs contributing to this growing 
Interast have been the attainment of independence by nuMroua pi^®" 
vibusjy colonial status countries . (with consequent Incr^^^es . in ^s^' 
piratlpns and roles in Inte^atlonal 'affairs) ? ^international t^^de 
and labor systetnSj Tapid technological gr^yth in the 9,^^^ half t*' 
century, 'and increased confidence in the potential of 1t®^Jinology 
to contribute to the solution pf development programs. 



On the one handj the is6&^ of d^vploptnent may be perceived as arising 
from the ^fact that there a^re signifilcant differences betwe4n*the 
^'iilliustrialized*' or "developed" couhtrles (00) and 't He "develop tng'*_ 
ot. "leaser developed" ^countries. \ 

On the other hand^ however, it is also liQportant/to recognlge the 
saverity of the ecpnomlc' conditions of the LDCs themselves = - -apart 
.from any comparison with the DCs ; These conditions both prese^ ^ , human 
problem of major dimensions and constitute a serious threat twthe . 
political, and economic stal^ility of these nation states C^Hlch in turn 
does have Implications, at the international level) \ ^ - not to mention 
implications for the social/cultural fabric of a society. 

The develppment problem has been approached from a vaVi^^y of perspec- 
tives and disciplines, each with its own weaknesses and limitations. 
In recent years the concept of Appropriate Technology Ra^ been f^^®ivlng 
increased attention by those who are concerned with tecnnology utili- 
zation in developing countries* The Appropriate Technology concept does 
take us a step In the right direction ot recogniEing the importance of 
the specific conteKt relevant to developTnent ^nd the role technology^ 
However J we mus^t recognize that the Appropriate Technology ^oncept is 
itself a specific, particular type of approach which has sl|^nlfleant 
limitations * ' 

Thus, there remains an Imperative need for the development . of k compile* 
hensiire conteKtual analytical framework In order to avoid the mistakes 
that have occurred in past efforts to relate technology R&D, transfer 
and utilization to the development needs of developing ^P^nfries r 
mistakes which have resulted In accusations of economic exploitation ; 
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and datri-^atlon of the LDCi* Many of these mlitakeg have resulted from " 
Inadequate analyses both of the situation In the LDC's and of the role ' ' , 

that DC' fi qan .pl*y In the process of deyelopment - which In .turn 
has been du^ to a lack of a comprehensive analytical framework that • . 
slffiulcaneously 1^ trnie to the existing tfeallt^ atid permits the gener- 
. atton of policy rela^rant Information In th;Ls conteKt. The CISST con- ]^ 
teKtlifll analytlj^fl fraipeWoA Is well suited for In-depth contextual 
analysis, of sltu^atlohs such as developiflent (and of issues .such as role 
of technology In developw^^t) which ffequlre consideration of, a coB^lax- V. ^ 
set: of interact tve .factors ahd dynamics ; our contextual analytical 
framework provides a methodology., which can be utlltisd by an. agency 
to identify and evaluate pollcy/program level^^lssues and options j as ^ ^ ; f 
:w.ell a§ Idetitifyi^g areas vrtiere further research'^la needed. * 

The , historlcal'^evolution ^nd current Issues of development and the , 
current concerns ltldlcat# that' the CISST cdnteKtual analytical frame- 
Work would be applicable to the problem of development and thus would . 
be relevant and useful to agencies concerned with such issues. 
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